Max level shown:
1 [ Sep 3 23:51:14 Enabled. ]
2 [ Sep 3 23:51:14 Rereading configuration. ]
3 [ Sep 3 23:51:16 Rereading configuration. ]
4 [ Sep 3 23:51:27 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/omicron-nexus/bin/nexus /var/svc/manifest/site/nexus/config.toml &"). ]
5 [ Sep 3 23:51:27 Method "start" exited with status 0. ]
6 note: configured to log to "/dev/stdout"
72024-09-03T23:51:27.681ZDEBGnexus: registered DTrace probes
82024-09-03T23:51:27.682ZINFOnexus: setting up nexus server file = nexus/src/lib.rs:74
92024-09-03T23:51:27.691ZINFOnexus (ServerContext): registering Oso class class = Action file = nexus/auth/src/authz/oso_generic.rs:68
102024-09-03T23:51:27.691ZINFOnexus (ServerContext): registering Oso class class = AnyActor file = nexus/auth/src/authz/oso_generic.rs:68
112024-09-03T23:51:27.691ZINFOnexus (ServerContext): registering Oso class class = AuthenticatedActor file = nexus/auth/src/authz/oso_generic.rs:68
122024-09-03T23:51:27.692ZINFOnexus (ServerContext): registering Oso class class = BlueprintConfig file = nexus/auth/src/authz/oso_generic.rs:68
132024-09-03T23:51:27.692ZINFOnexus (ServerContext): registering Oso class class = Database file = nexus/auth/src/authz/oso_generic.rs:68
142024-09-03T23:51:27.692ZINFOnexus (ServerContext): registering Oso class class = DnsConfig file = nexus/auth/src/authz/oso_generic.rs:68
152024-09-03T23:51:27.692ZINFOnexus (ServerContext): registering Oso class class = Fleet file = nexus/auth/src/authz/oso_generic.rs:68
162024-09-03T23:51:27.692ZINFOnexus (ServerContext): registering Oso class class = Inventory file = nexus/auth/src/authz/oso_generic.rs:68
172024-09-03T23:51:27.692ZINFOnexus (ServerContext): registering Oso class class = IpPoolList file = nexus/auth/src/authz/oso_generic.rs:68
182024-09-03T23:51:27.692ZINFOnexus (ServerContext): registering Oso class class = ConsoleSessionList file = nexus/auth/src/authz/oso_generic.rs:68
192024-09-03T23:51:27.692ZINFOnexus (ServerContext): registering Oso class class = DeviceAuthRequestList file = nexus/auth/src/authz/oso_generic.rs:68
202024-09-03T23:51:27.692ZINFOnexus (ServerContext): registering Oso class class = SiloCertificateList file = nexus/auth/src/authz/oso_generic.rs:68
212024-09-03T23:51:27.692ZINFOnexus (ServerContext): registering Oso class class = SiloIdentityProviderList file = nexus/auth/src/authz/oso_generic.rs:68
222024-09-03T23:51:27.692ZINFOnexus (ServerContext): registering Oso class class = SiloUserList file = nexus/auth/src/authz/oso_generic.rs:68
232024-09-03T23:51:27.692ZINFOnexus (ServerContext): registering Oso class class = Project file = nexus/auth/src/authz/oso_generic.rs:68
242024-09-03T23:51:27.692ZINFOnexus (ServerContext): registering Oso class class = Disk file = nexus/auth/src/authz/oso_generic.rs:68
252024-09-03T23:51:27.692ZINFOnexus (ServerContext): registering Oso class class = Snapshot file = nexus/auth/src/authz/oso_generic.rs:68
262024-09-03T23:51:27.692ZINFOnexus (ServerContext): registering Oso class class = ProjectImage file = nexus/auth/src/authz/oso_generic.rs:68
272024-09-03T23:51:27.692ZINFOnexus (ServerContext): registering Oso class class = Instance file = nexus/auth/src/authz/oso_generic.rs:68
282024-09-03T23:51:27.692ZINFOnexus (ServerContext): registering Oso class class = IpPool file = nexus/auth/src/authz/oso_generic.rs:68
292024-09-03T23:51:27.692ZINFOnexus (ServerContext): registering Oso class class = InstanceNetworkInterface file = nexus/auth/src/authz/oso_generic.rs:68
302024-09-03T23:51:27.692ZINFOnexus (ServerContext): registering Oso class class = Vpc file = nexus/auth/src/authz/oso_generic.rs:68
312024-09-03T23:51:27.692ZINFOnexus (ServerContext): registering Oso class class = VpcRouter file = nexus/auth/src/authz/oso_generic.rs:68
322024-09-03T23:51:27.692ZINFOnexus (ServerContext): registering Oso class class = RouterRoute file = nexus/auth/src/authz/oso_generic.rs:68
332024-09-03T23:51:27.692ZINFOnexus (ServerContext): registering Oso class class = VpcSubnet file = nexus/auth/src/authz/oso_generic.rs:68
342024-09-03T23:51:27.692ZINFOnexus (ServerContext): registering Oso class class = FloatingIp file = nexus/auth/src/authz/oso_generic.rs:68
352024-09-03T23:51:27.692ZINFOnexus (ServerContext): registering Oso class class = Image file = nexus/auth/src/authz/oso_generic.rs:68
362024-09-03T23:51:27.692ZINFOnexus (ServerContext): registering Oso class class = SiloImage file = nexus/auth/src/authz/oso_generic.rs:68
372024-09-03T23:51:27.692ZINFOnexus (ServerContext): registering Oso class class = AddressLot file = nexus/auth/src/authz/oso_generic.rs:68
382024-09-03T23:51:27.692ZINFOnexus (ServerContext): registering Oso class class = Blueprint file = nexus/auth/src/authz/oso_generic.rs:68
392024-09-03T23:51:27.692ZINFOnexus (ServerContext): registering Oso class class = LoopbackAddress file = nexus/auth/src/authz/oso_generic.rs:68
402024-09-03T23:51:27.692ZINFOnexus (ServerContext): registering Oso class class = Certificate file = nexus/auth/src/authz/oso_generic.rs:68
412024-09-03T23:51:27.692ZINFOnexus (ServerContext): registering Oso class class = ConsoleSession file = nexus/auth/src/authz/oso_generic.rs:68
422024-09-03T23:51:27.692ZINFOnexus (ServerContext): registering Oso class class = DeviceAuthRequest file = nexus/auth/src/authz/oso_generic.rs:68
432024-09-03T23:51:27.692ZINFOnexus (ServerContext): registering Oso class class = DeviceAccessToken file = nexus/auth/src/authz/oso_generic.rs:68
442024-09-03T23:51:27.692ZINFOnexus (ServerContext): registering Oso class class = PhysicalDisk file = nexus/auth/src/authz/oso_generic.rs:68
452024-09-03T23:51:27.692ZINFOnexus (ServerContext): registering Oso class class = Rack file = nexus/auth/src/authz/oso_generic.rs:68
462024-09-03T23:51:27.692ZINFOnexus (ServerContext): registering Oso class class = RoleBuiltin file = nexus/auth/src/authz/oso_generic.rs:68
472024-09-03T23:51:27.692ZINFOnexus (ServerContext): registering Oso class class = SshKey file = nexus/auth/src/authz/oso_generic.rs:68
482024-09-03T23:51:27.692ZINFOnexus (ServerContext): registering Oso class class = Silo file = nexus/auth/src/authz/oso_generic.rs:68
492024-09-03T23:51:27.692ZINFOnexus (ServerContext): registering Oso class class = SiloUser file = nexus/auth/src/authz/oso_generic.rs:68
502024-09-03T23:51:27.693ZINFOnexus (ServerContext): registering Oso class class = SiloGroup file = nexus/auth/src/authz/oso_generic.rs:68
512024-09-03T23:51:27.693ZINFOnexus (ServerContext): registering Oso class class = IdentityProvider file = nexus/auth/src/authz/oso_generic.rs:68
522024-09-03T23:51:27.693ZINFOnexus (ServerContext): registering Oso class class = SamlIdentityProvider file = nexus/auth/src/authz/oso_generic.rs:68
532024-09-03T23:51:27.693ZINFOnexus (ServerContext): registering Oso class class = Sled file = nexus/auth/src/authz/oso_generic.rs:68
542024-09-03T23:51:27.693ZINFOnexus (ServerContext): registering Oso class class = TufRepo file = nexus/auth/src/authz/oso_generic.rs:68
552024-09-03T23:51:27.693ZINFOnexus (ServerContext): registering Oso class class = TufArtifact file = nexus/auth/src/authz/oso_generic.rs:68
562024-09-03T23:51:27.693ZINFOnexus (ServerContext): registering Oso class class = Zpool file = nexus/auth/src/authz/oso_generic.rs:68
572024-09-03T23:51:27.693ZINFOnexus (ServerContext): registering Oso class class = Service file = nexus/auth/src/authz/oso_generic.rs:68
582024-09-03T23:51:27.693ZINFOnexus (ServerContext): registering Oso class class = UserBuiltin file = nexus/auth/src/authz/oso_generic.rs:68
592024-09-03T23:51:27.693ZINFOnexus (ServerContext): full Oso configuration config = #\n# Oso configuration for Omicron\n# This file is augmented by generated snippets.\n#\n\n#\n# ACTOR TYPES AND BASIC RULES\n#\n\n# `AnyActor` includes both authenticated and unauthenticated users.\nactor AnyActor {}\n\n# An `AuthenticatedActor` has an identity in the system. All of our operations\n# today require that an actor be authenticated.\nactor AuthenticatedActor {}\n\n# For any resource, `actor` can perform action `action` on it if they're\n# authenticated and their role(s) give them the corresponding permission on that\n# resource.\nallow(actor: AnyActor, action: Action, resource) if\n actor.authenticated and\n has_permission(actor.authn_actor.unwrap(), action.to_perm(), resource);\n\n# Define role relationships\nhas_role(actor: AuthenticatedActor, role: String, resource: Resource)\n\tif resource.has_role(actor, role);\n\n#\n# ROLES AND PERMISSIONS IN THE FLEET/SILO/PROJECT HIERARCHY\n#\n# We define the following permissions for most resources in the system:\n#\n# - "create_child": required to create child resources (of any type)\n#\n# - "list_children": required to list child resources (of all types) of a\n# resource\n#\n# - "modify": required to modify or delete a resource\n#\n# - "read": required to read a resource\n#\n# We define the following predefined roles for only a few high-level resources:\n# the Fleet (see below), Silo, Organization, and Project. The specific roles\n# are oriented around intended use-cases:\n#\n# - "admin": has all permissions on the resource\n#\n# - "collaborator": has "read", "list_children", and "create_child", plus\n# the "admin" role for child resources. The idea is that if you're an\n# Organization Collaborator, you have full control over the Projects within\n# the Organization, but you cannot modify or delete the Organization itself.\n#\n# - "viewer": has "read" and "list_children" on a resource\n#\n# Below the Project level, permissions are granted via roles at the Project\n# level. For example, for someone to be able to create, modify, or delete any\n# Instances, they must be granted project.collaborator, which means they can\n# create, modify, or delete _all_ resources in the Project.\n#\n# The complete set of predefined roles:\n#\n# - fleet.admin (superuser for the whole system)\n# - fleet.collaborator (can manage Silos)\n# - fleet.viewer (can read most non-siloed resources in the system)\n# - silo.admin (superuser for the silo)\n# - silo.collaborator (can create and own Organizations)\n# - silo.viewer (can read most resources within the Silo)\n# - organization.admin (complete control over an organization)\n# - organization.collaborator (can manage Projects)\n# - organization.viewer (can read most resources within the Organization)\n# - project.admin (complete control over a Project)\n# - project.collaborator (can manage all resources within the Project)\n# - project.viewer (can read most resources within the Project)\n#\n# Outside the Silo/Organization/Project hierarchy, we (currently) treat most\n# resources as nested under Fleet or else a synthetic resource (see below). We\n# do not yet support role assignments on anything other than Fleet, Silo,\n# Organization, or Project.\n#\n\n# "Fleet" is a global singleton representing the whole system. The name comes\n# from the idea described in RFD 24, but it's not quite right. This probably\n# should be more like "Region" or "AvailabilityZone". The precise boundaries\n# have not yet been figured out.\nresource Fleet {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\troles = [\n\t # Roles that can be attached by users\n\t "admin",\n\t "collaborator",\n\t "viewer",\n\n\t # Internal-only roles\n\t "external-authenticator"\n\t];\n\n\t# Roles implied by other roles on this resource\n\t"viewer" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\t"create_child" if "collaborator";\n\t"modify" if "admin";\n}\n\n# For fleets specifically, roles can be conferred by roles on the user's Silo.\nhas_role(actor: AuthenticatedActor, role: String, _: Fleet) if\n\tsilo_role in actor.confers_fleet_role(role) and\n\thas_role(actor, silo_role, actor.silo.unwrap());\n\nresource Silo {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\troles = [ "admin", "collaborator", "viewer" ];\n\n\t# Roles implied by other roles on this resource\n\t"viewer" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\n\t"create_child" if "collaborator";\n\t"modify" if "admin";\n\n\t# Permissions implied by roles on this resource's parent (Fleet). Fleet\n\t# privileges allow a user to see and potentially administer the Silo,\n\t# but they do not give anyone permission to look at anything inside the\n\t# Silo. To achieve this, we use permission rules here. (If we granted\n\t# Fleet administrators _roles_ on the Silo, then those would cascade\n\t# into the Silo as well.)\n\trelations = { parent_fleet: Fleet };\n\t"read" if "viewer" on "parent_fleet";\n\t"modify" if "collaborator" on "parent_fleet";\n\n\t# external authenticator has to create silo users\n\t"list_children" if "external-authenticator" on "parent_fleet";\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\n\nhas_relation(fleet: Fleet, "parent_fleet", silo: Silo)\n\tif silo.fleet = fleet;\n\n# As a special case, all authenticated users can read their own Silo. That's\n# not quite the same as having the "viewer" role. For example, they cannot list\n# Organizations in the Silo.\n#\n# One reason this is necessary is because if an unprivileged user tries to\n# create an Organization using "POST /organizations", they should get back a 403\n# (which implies they're able to see /organizations, which is essentially seeing\n# the Silo itself) rather than a 404. This behavior isn't a hard constraint\n# (i.e., you could reasonably get a 404 for an API you're not allowed to call).\n# Nor is the implementation (i.e., we could special-case this endpoint somehow).\n# But granting this permission is the simplest way to keep this endpoint's\n# behavior consistent with the rest of the API.\n#\n# This rule is also used to determine if a user can list the identity providers\n# in the Silo (which they should be able to), since that's predicated on being\n# able to read the Silo.\n#\n# It's unclear what else would break if users couldn't see their own Silo.\nhas_permission(actor: AuthenticatedActor, "read", silo: Silo)\n\tif silo in actor.silo;\n\nresource Project {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\troles = [ "admin", "collaborator", "viewer" ];\n\n\t# Roles implied by other roles on this resource\n\t"viewer" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\t"create_child" if "collaborator";\n\t"modify" if "admin";\n\n\t# Roles implied by roles on this resource's parent (Silo)\n\trelations = { parent_silo: Silo };\n\t"admin" if "collaborator" on "parent_silo";\n\t"viewer" if "viewer" on "parent_silo";\n}\nhas_relation(silo: Silo, "parent_silo", project: Project)\n\tif project.silo = silo;\n\n#\n# GENERAL RESOURCES OUTSIDE THE SILO/PROJECT HIERARCHY\n#\n# Many resources use snippets of Polar generated by the `authz_resource!` Rust\n# macro. Some resources require custom Polar code. Those appear here.\n#\n\nresource Certificate {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Fleet-level and silo-level roles both grant privileges on certificates.\n\t"read" if "admin" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"read" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", certificate: Certificate)\n\tif certificate.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", certificate: Certificate)\n\tif certificate.silo.fleet = fleet;\n\nresource SiloUser {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\t# Fleet and Silo administrators can manage a Silo's users. This is one\n\t# of the only areas of Silo configuration that Fleet Administrators have\n\t# permissions on.\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\t"list_children" if "read" on "parent_silo";\n\t"read" if "read" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\t"list_children" if "read" on "parent_fleet";\n\t"read" if "read" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", user: SiloUser)\n\tif user.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", user: SiloUser)\n\tif user.silo.fleet = fleet;\n\n# authenticated actors have all permissions on themselves\nhas_permission(actor: AuthenticatedActor, _perm: String, silo_user: SiloUser)\n if actor.equals_silo_user(silo_user);\n\nhas_permission(actor: AuthenticatedActor, "read", silo_user: SiloUser)\n if silo_user.silo in actor.silo;\n\nresource SiloGroup {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\trelations = { parent_silo: Silo };\n\t"list_children" if "read" on "parent_silo";\n\t"read" if "read" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n}\nhas_relation(silo: Silo, "parent_silo", group: SiloGroup)\n\tif group.silo = silo;\n\nresource SshKey {\n\tpermissions = [ "read", "modify" ];\n\trelations = { silo_user: SiloUser };\n\n\t"read" if "read" on "silo_user";\n\t"modify" if "modify" on "silo_user";\n}\nhas_relation(user: SiloUser, "silo_user", ssh_key: SshKey)\n\tif ssh_key.silo_user = user;\n\nresource IdentityProvider {\n\tpermissions = [\n\t "read",\n\t "modify",\n\t "create_child",\n\t "list_children",\n\t];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Silo-level roles grant privileges on identity providers.\n\t"read" if "viewer" on "parent_silo";\n\t"list_children" if "viewer" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\n\t# Fleet-level roles also grant privileges on identity providers.\n\t"read" if "viewer" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", identity_provider: IdentityProvider)\n\tif identity_provider.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: IdentityProvider)\n\tif collection.silo.fleet = fleet;\n\nresource SamlIdentityProvider {\n\tpermissions = [\n\t "read",\n\t "modify",\n\t "create_child",\n\t "list_children",\n\t];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Silo-level roles grant privileges on identity providers.\n\t"read" if "viewer" on "parent_silo";\n\t"list_children" if "viewer" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\n\t# Fleet-level roles also grant privileges on identity providers.\n\t"read" if "viewer" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", saml_identity_provider: SamlIdentityProvider)\n\tif saml_identity_provider.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SamlIdentityProvider)\n\tif collection.silo.fleet = fleet;\n\n#\n# SYNTHETIC RESOURCES OUTSIDE THE SILO HIERARCHY\n#\n# The resources here do not correspond to anything that appears explicitly in\n# the API or is stored in the database. These are used either at the top level\n# of the API path (e.g., "/v1/system/ip-pools") or as an implementation detail of the system\n# (in the case of console sessions and "Database"). The policies are\n# either statically-defined in this file or driven by role assignments on the\n# Fleet. None of these resources defines their own roles.\n#\n\n# Describes the policy for reading and modifying DNS configuration\n# (both internal and external)\nresource DnsConfig {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_fleet: Fleet };\n\t# "external-authenticator" requires these permissions because that's the\n\t# context that Nexus uses when creating and deleting Silos. These\n\t# operations necessarily need to read and modify DNS configuration.\n\t"read" if "external-authenticator" on "parent_fleet";\n\t"modify" if "external-authenticator" on "parent_fleet";\n\t# "admin" on the parent fleet also gets these permissions, primarily for\n\t# the test suite.\n\t"read" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", dns_config: DnsConfig)\n\tif dns_config.fleet = fleet;\n\n# Describes the policy for accessing blueprints\nresource BlueprintConfig {\n\tpermissions = [\n\t "list_children", # list blueprints\n\t "create_child", # create blueprint\n\t "read", # read the current target\n\t "modify", # change the current target\n\t];\n\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"read" if "viewer" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", list: BlueprintConfig)\n\tif list.fleet = fleet;\n\n# Describes the policy for reading and modifying low-level inventory\nresource Inventory {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_fleet: Fleet };\n\t"read" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", inventory: Inventory)\n\tif inventory.fleet = fleet;\n\n# Describes the policy for accessing "/v1/system/ip-pools" in the API\nresource IpPoolList {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "create_child",\n\t];\n\n\t# Fleet Administrators can create or modify the IP Pools list.\n\trelations = { parent_fleet: Fleet };\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n\n\t# Fleet Viewers can list IP Pools\n\t"list_children" if "viewer" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", ip_pool_list: IpPoolList)\n\tif ip_pool_list.fleet = fleet;\n\n# Any authenticated user can create a child of a provided IP Pool.\n# This is necessary to use the pools when provisioning instances.\nhas_permission(actor: AuthenticatedActor, "create_child", ip_pool: IpPool)\n\tif silo in actor.silo and silo.fleet = ip_pool.fleet;\n\n# Describes the policy for creating and managing web console sessions.\nresource ConsoleSessionList {\n\tpermissions = [ "create_child" ];\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", collection: ConsoleSessionList)\n\tif collection.fleet = fleet;\n\n# Describes the policy for creating and managing device authorization requests.\nresource DeviceAuthRequestList {\n\tpermissions = [ "create_child" ];\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", collection: DeviceAuthRequestList)\n\tif collection.fleet = fleet;\n\n# Describes the policy for creating and managing Silo certificates\nresource SiloCertificateList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Both Fleet and Silo administrators can see and modify the Silo's\n\t# certificates.\n\t"list_children" if "admin" on "parent_silo";\n\t"list_children" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloCertificateList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloCertificateList)\n\tif collection.silo.fleet = fleet;\n\n# Describes the policy for creating and managing Silo identity providers\nresource SiloIdentityProviderList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Everyone who can read the Silo (which includes all the users in the\n\t# Silo) can see the identity providers in it.\n\t"list_children" if "read" on "parent_silo";\n\n\t# Fleet and Silo administrators can manage the Silo's identity provider\n\t# configuration. This is one of the only areas of Silo configuration\n\t# that Fleet Administrators have permissions on. This is also one of\n\t# the only cases where we need to look two levels up the hierarchy to\n\t# see if somebody has the right permission. For most other things,\n\t# permissions cascade down the hierarchy so we only need to look at the\n\t# parent.\n\t"create_child" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloIdentityProviderList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloIdentityProviderList)\n\tif collection.silo.fleet = fleet;\n\n# Describes the policy for creating and managing Silo users (mostly intended for\n# API-managed users)\nresource SiloUserList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Everyone who can read the Silo (which includes all the users in the\n\t# Silo) can see the users in it.\n\t"list_children" if "read" on "parent_silo";\n\n\t# Fleet and Silo administrators can manage the Silo's users. This is\n\t# one of the only areas of Silo configuration that Fleet Administrators\n\t# have permissions on. This is also one of the few cases (so far) where\n\t# we need to look two levels up the hierarchy to see if somebody has the\n\t# right permission. For most other things, permissions cascade down the\n\t# hierarchy so we only need to look at the parent.\n\t"create_child" if "admin" on "parent_silo";\n\t"list_children" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloUserList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloUserList)\n\tif collection.silo.fleet = fleet;\n\n# These rules grants the external authenticator role the permissions it needs to\n# read silo users and modify their sessions. This is necessary for login to\n# work.\nhas_permission(actor: AuthenticatedActor, "read", silo: Silo)\n\tif has_role(actor, "external-authenticator", silo.fleet);\nhas_permission(actor: AuthenticatedActor, "read", user: SiloUser)\n\tif has_role(actor, "external-authenticator", user.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", user: SiloUser)\n\tif has_role(actor, "external-authenticator", user.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "read", group: SiloGroup)\n\tif has_role(actor, "external-authenticator", group.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", group: SiloGroup)\n\tif has_role(actor, "external-authenticator", group.silo.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", session: ConsoleSession)\n\tif has_role(actor, "external-authenticator", session.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", session: ConsoleSession)\n\tif has_role(actor, "external-authenticator", session.fleet);\n\n# All authenticated users can read and delete device authn requests because\n# by necessity these operations happen before we've figured out what user (or\n# even Silo) the device auth is associated with. Any user can claim a device\n# auth request with the right user code (that's how it works) -- it's the user\n# code and associated logic that prevents unauthorized access here.\nhas_permission(_actor: AuthenticatedActor, "read", _device_auth: DeviceAuthRequest);\nhas_permission(_actor: AuthenticatedActor, "modify", _device_auth: DeviceAuthRequest);\n\nhas_permission(actor: AuthenticatedActor, "read", device_token: DeviceAccessToken)\n\tif has_role(actor, "external-authenticator", device_token.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", identity_provider: IdentityProvider)\n\tif has_role(actor, "external-authenticator", identity_provider.silo.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", saml_identity_provider: SamlIdentityProvider)\n\tif has_role(actor, "external-authenticator", saml_identity_provider.silo.fleet);\n\n# Describes the policy for who can access the internal database.\nresource Database {\n\tpermissions = [\n\t # "query" is required to perform any query against the database,\n\t # whether a read or write query. This is checked when an operation\n\t # checks out a database connection from the connection pool.\n\t #\n\t # Any authenticated user gets this permission. There's generally\n\t # some other authz check involved in the database query. For\n\t # example, if you're querying the database to "read" a "Project", we\n\t # should also be checking that. So why do we do this at all? It's\n\t # a belt-and-suspenders measure so that if we somehow introduced an\n\t # unauthenticated code path that hits the database, it cannot be\n\t # used to DoS the database because we won't allow the operation to\n\t # make the query. (As long as the code path _is_ authenticated, we\n\t # can use throttling mechanisms to prevent DoS.)\n\t "query",\n\n\t # "modify" is required to populate database data that's delivered\n\t # with the system. It should also be required for schema changes,\n\t # when we support those. This is separate from "query" so that we\n\t # cannot accidentally invoke these code paths from API calls and\n\t # other general functions.\n\t "modify"\n\t];\n}\n\n# All authenticated users have the "query" permission on the database.\nhas_permission(_actor: AuthenticatedActor, "query", _resource: Database);\n\n# The "db-init" user is the only one with the "modify" permission.\nhas_permission(USER_DB_INIT: AuthenticatedActor, "modify", _resource: Database);\nhas_permission(USER_DB_INIT: AuthenticatedActor, "create_child", _resource: IpPoolList);\n# It also has "admin" on the internal silo to populate it with built-in resources.\n# TODO-completeness: actually limit to just internal silo and not all silos\nhas_role(USER_DB_INIT: AuthenticatedActor, "admin", _silo: Silo);\n\n# Allow the internal API admin permissions on all silos.\nhas_role(USER_INTERNAL_API: AuthenticatedActor, "admin", _silo: Silo);\n\n\n\n resource Disk {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Disk)\n if child.project = parent;\n \n\n resource Snapshot {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Snapshot)\n if child.project = parent;\n \n\n resource ProjectImage {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: ProjectImage)\n if child.project = parent;\n \n\n resource Instance {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Instance)\n if child.project = parent;\n \n\n resource IpPool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: IpPool)\n if child.fleet = fleet;\n \n\n resource InstanceNetworkInterface {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Instance\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InstanceNetworkInterface)\n if has_relation(project, "containing_project", child.instance);\n\n has_relation(parent: Instance, "parent", child: InstanceNetworkInterface)\n if child.instance = parent;\n \n\n resource Vpc {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Vpc)\n if child.project = parent;\n \n\n resource VpcRouter {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Vpc\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: VpcRouter)\n if has_relation(project, "containing_project", child.vpc);\n\n has_relation(parent: Vpc, "parent", child: VpcRouter)\n if child.vpc = parent;\n \n\n resource RouterRoute {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: VpcRouter\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: RouterRoute)\n if has_relation(project, "containing_project", child.vpc_router);\n\n has_relation(parent: VpcRouter, "parent", child: RouterRoute)\n if child.vpc_router = parent;\n \n\n resource VpcSubnet {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Vpc\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: VpcSubnet)\n if has_relation(project, "containing_project", child.vpc);\n\n has_relation(parent: Vpc, "parent", child: VpcSubnet)\n if child.vpc = parent;\n \n\n resource FloatingIp {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: FloatingIp)\n if child.project = parent;\n \n\n resource Image {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_silo: Silo };\n "list_children" if "viewer" on "containing_silo";\n "read" if "viewer" on "containing_silo";\n "modify" if "collaborator" on "containing_silo";\n "create_child" if "collaborator" on "containing_silo";\n }\n\n has_relation(parent: Silo, "containing_silo", child: Image)\n if child.silo = parent;\n \n\n resource SiloImage {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_silo: Silo };\n "list_children" if "viewer" on "containing_silo";\n "read" if "viewer" on "containing_silo";\n "modify" if "collaborator" on "containing_silo";\n "create_child" if "collaborator" on "containing_silo";\n }\n\n has_relation(parent: Silo, "containing_silo", child: SiloImage)\n if child.silo = parent;\n \n\n resource AddressLot {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: AddressLot)\n if child.fleet = fleet;\n \n\n resource Blueprint {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Blueprint)\n if child.fleet = fleet;\n \n\n resource LoopbackAddress {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: LoopbackAddress)\n if child.fleet = fleet;\n \n\n\n resource ConsoleSession {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: ConsoleSession)\n if child.fleet = fleet;\n \n\n resource DeviceAuthRequest {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: DeviceAuthRequest)\n if child.fleet = fleet;\n \n\n resource DeviceAccessToken {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: DeviceAccessToken)\n if child.fleet = fleet;\n \n\n resource PhysicalDisk {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: PhysicalDisk)\n if child.fleet = fleet;\n \n\n resource Rack {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Rack)\n if child.fleet = fleet;\n \n\n resource RoleBuiltin {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: RoleBuiltin)\n if child.fleet = fleet;\n \n\n\n\n\n\n\n\n resource Sled {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Sled)\n if child.fleet = fleet;\n \n\n resource TufRepo {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: TufRepo)\n if child.fleet = fleet;\n \n\n resource TufArtifact {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: TufArtifact)\n if child.fleet = fleet;\n \n\n resource Zpool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Zpool)\n if child.fleet = fleet;\n \n\n resource Service {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Service)\n if child.fleet = fleet;\n \n\n resource UserBuiltin {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: UserBuiltin)\n if child.fleet = fleet;\n file = nexus/auth/src/authz/oso_generic.rs:89
602024-09-03T23:51:27.711ZINFOnexus (ServerContext): Setting up resolver using DNS servers for subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344::, width: 48 } } file = nexus/src/context.rs:216
612024-09-03T23:51:27.715ZINFOnexus (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = internal-dns/src/resolver.rs:73
622024-09-03T23:51:27.719ZINFOnexus (ServerContext): Setting up qorb pool from DNS dns_addrs = [\n [fd00:1122:3344:1::1]:53,\n [fd00:1122:3344:2::1]:53,\n [fd00:1122:3344:3::1]:53,\n [fd00:1122:3344:4::1]:53,\n [fd00:1122:3344:5::1]:53,\n] file = nexus/src/context.rs:265
632024-09-03T23:51:37.770ZINFOnexus: Database schema version is up to date desired_version = 94.0.0 file = nexus/db-queries/src/db/datastore/db_metadata.rs:145 found_version = 94.0.0
642024-09-03T23:51:37.772ZINFOnexus (SEC): SEC running file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:813 sec_id = 5f5ce676-2064-4d97-b873-fbcbc29495de
652024-09-03T23:51:37.773ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b281022b-35b2-452e-ad2b-78e12f6ca16a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b281022b-35b2-452e-ad2b-78e12f6ca16a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1076, tv_nsec: 275211447 } })
662024-09-03T23:51:37.774ZINFOnexus (Nexus): Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1050
672024-09-03T23:51:37.823ZINFOnexus (Nexus): determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
682024-09-03T23:51:37.823ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
692024-09-03T23:51:37.828ZDEBGnexus (MgsClient): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "fabc4af1-4675-40b3-97e2-7776bdc83247", "content-length": "26", "date": "Tue, 03 Sep 2024 23:51:37 GMT"} })
702024-09-03T23:51:37.829ZINFOnexus (Nexus): identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
712024-09-03T23:51:37.829ZINFOnexus (Nexus): completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
722024-09-03T23:51:37.859ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b281022b-35b2-452e-ad2b-78e12f6ca16a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b281022b-35b2-452e-ad2b-78e12f6ca16a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1076, tv_nsec: 362031716 } })
732024-09-03T23:51:37.860ZINFOnexus (Nexus): Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1050
742024-09-03T23:51:37.895ZINFOnexus (Nexus): determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
752024-09-03T23:51:37.895ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
762024-09-03T23:51:37.896ZDEBGnexus (MgsClient): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d2e9ea48-9a75-49db-b7f5-dfd9c6d554d1", "content-length": "26", "date": "Tue, 03 Sep 2024 23:51:37 GMT"} })
772024-09-03T23:51:37.896ZINFOnexus (Nexus): identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
782024-09-03T23:51:37.896ZINFOnexus (Nexus): completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
792024-09-03T23:51:37.969ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
802024-09-03T23:51:37.980ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
812024-09-03T23:51:37.981ZDEBGnexus (DataLoader): attempting to create built-in users
822024-09-03T23:51:37.981ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
832024-09-03T23:51:37.981ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
842024-09-03T23:51:37.986ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /artifacts/{kind}/{name}/{version}
852024-09-03T23:51:37.986ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /bgtasks
862024-09-03T23:51:37.986ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /bgtasks/activate
872024-09-03T23:51:37.986ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /bgtasks/view/{bgtask_name}
882024-09-03T23:51:37.986ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/downstairs/{downstairs_id}/stop-request
892024-09-03T23:51:37.986ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/downstairs/{downstairs_id}/stopped
902024-09-03T23:51:37.986ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/repair/{repair_id}/progress
912024-09-03T23:51:37.986ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/repair-finish
922024-09-03T23:51:37.986ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/repair-start
932024-09-03T23:51:37.986ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /demo-saga
942024-09-03T23:51:37.986ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /demo-saga/{demo_saga_id}/complete
952024-09-03T23:51:37.986ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /deployment/blueprints/all
962024-09-03T23:51:37.986ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = DELETE path = /deployment/blueprints/all/{blueprint_id}
972024-09-03T23:51:37.986ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /deployment/blueprints/all/{blueprint_id}
982024-09-03T23:51:37.986ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /deployment/blueprints/import
992024-09-03T23:51:37.986ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /deployment/blueprints/regenerate
1002024-09-03T23:51:37.987ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /deployment/blueprints/target
1012024-09-03T23:51:37.987ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /deployment/blueprints/target
1022024-09-03T23:51:37.987ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = PUT path = /deployment/blueprints/target/enabled
1032024-09-03T23:51:37.987ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /disk/{disk_id}/remove-read-only-parent
1042024-09-03T23:51:37.987ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = PUT path = /disks/{disk_id}
1052024-09-03T23:51:37.987ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /instances/{instance_id}/migrate
1062024-09-03T23:51:37.987ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /metrics/collectors
1072024-09-03T23:51:37.987ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /metrics/collectors/{collector_id}/producers
1082024-09-03T23:51:37.987ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /metrics/producers
1092024-09-03T23:51:37.987ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /nat/ipv4/changeset/{from_gen}
1102024-09-03T23:51:37.987ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /physical-disk/expunge
1112024-09-03T23:51:37.987ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /probes/{sled}
1122024-09-03T23:51:37.987ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = PUT path = /racks/{rack_id}/initialization-complete
1132024-09-03T23:51:37.987ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /sagas
1142024-09-03T23:51:37.987ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /sagas/{saga_id}
1152024-09-03T23:51:37.987ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /sled-agents/{sled_id}
1162024-09-03T23:51:37.987ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /sled-agents/{sled_id}
1172024-09-03T23:51:37.987ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /sled-agents/{sled_id}/firewall-rules-update
1182024-09-03T23:51:37.987ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /sleds/add
1192024-09-03T23:51:37.987ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /sleds/expunge
1202024-09-03T23:51:37.987ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /sleds/uninitialized
1212024-09-03T23:51:37.987ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = PUT path = /switch/{switch_id}
1222024-09-03T23:51:37.987ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = PUT path = /vmms/{propolis_id}
1232024-09-03T23:51:37.987ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /volume/{volume_id}/remove-read-only-parent
1242024-09-03T23:51:37.987ZINFOnexus (dropshot_internal): listening file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:205 local_addr = [fd00:1122:3344:101::c]:12221
1252024-09-03T23:51:37.987ZDEBGnexus (dropshot_internal): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::c]:12221
1262024-09-03T23:51:37.987ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
1272024-09-03T23:51:37.988ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
1282024-09-03T23:51:37.990ZWARNnexus: Cannot look up rack: Object (of type ById(1d4636f4-828e-412a-8daf-3bda355c92df)) not found: rack file = nexus/src/app/rack.rs:771
1292024-09-03T23:51:37.999ZINFOnexus (DataLoader): created 0 built-in users file = nexus/db-queries/src/db/datastore/silo_user.rs:394
1302024-09-03T23:51:37.999ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1312024-09-03T23:51:38.000ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1322024-09-03T23:51:38.000ZDEBGnexus (DataLoader): attempting to create built-in roles
1332024-09-03T23:51:38.000ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1342024-09-03T23:51:38.001ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1352024-09-03T23:51:38.006ZINFOnexus (DataLoader): created 0 built-in roles file = nexus/db-queries/src/db/datastore/role.rs:85
1362024-09-03T23:51:38.006ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1372024-09-03T23:51:38.007ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1382024-09-03T23:51:38.007ZDEBGnexus (DataLoader): attempting to create built-in role assignments
1392024-09-03T23:51:38.007ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1402024-09-03T23:51:38.007ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1412024-09-03T23:51:38.038ZINFOnexus (DataLoader): created 0 built-in role assignments file = nexus/db-queries/src/db/datastore/role.rs:114
1422024-09-03T23:51:38.038ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1432024-09-03T23:51:38.039ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1442024-09-03T23:51:38.039ZDEBGnexus (DataLoader): attempting to create built-in silos
1452024-09-03T23:51:38.040ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1462024-09-03T23:51:38.040ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1472024-09-03T23:51:38.083ZINFOnexus (DataLoader): created 0 built-in silos file = nexus/db-queries/src/db/datastore/silo.rs:95
1482024-09-03T23:51:38.084ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1492024-09-03T23:51:38.084ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1502024-09-03T23:51:38.089ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1512024-09-03T23:51:38.089ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1522024-09-03T23:51:38.089ZDEBGnexus (DataLoader): attempting to create built-in projects
1532024-09-03T23:51:38.089ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1542024-09-03T23:51:38.090ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1552024-09-03T23:51:38.101ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1562024-09-03T23:51:38.101ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1572024-09-03T23:51:38.174ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1582024-09-03T23:51:38.174ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1592024-09-03T23:51:38.176ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1602024-09-03T23:51:38.178ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) } result = Ok(())
1612024-09-03T23:51:38.178ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1622024-09-03T23:51:38.178ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1632024-09-03T23:51:38.213ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1642024-09-03T23:51:38.213ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1652024-09-03T23:51:38.258ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1662024-09-03T23:51:38.260ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) } result = Ok(())
1672024-09-03T23:51:38.260ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1682024-09-03T23:51:38.260ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1692024-09-03T23:51:38.307ZINFOnexus (DataLoader): created built-in services project file = nexus/db-queries/src/db/datastore/project.rs:122
1702024-09-03T23:51:38.307ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1712024-09-03T23:51:38.308ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1722024-09-03T23:51:38.308ZDEBGnexus (DataLoader): attempting to create built-in VPCs
1732024-09-03T23:51:38.308ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1742024-09-03T23:51:38.308ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1752024-09-03T23:51:38.311ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1762024-09-03T23:51:38.311ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1772024-09-03T23:51:38.313ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1782024-09-03T23:51:38.313ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1792024-09-03T23:51:38.315ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1802024-09-03T23:51:38.315ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1812024-09-03T23:51:38.316ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1822024-09-03T23:51:38.316ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1832024-09-03T23:51:38.317ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1842024-09-03T23:51:38.320ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) } result = Ok(())
1852024-09-03T23:51:38.320ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1862024-09-03T23:51:38.320ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1872024-09-03T23:51:38.321ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1882024-09-03T23:51:38.322ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1892024-09-03T23:51:38.328ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1902024-09-03T23:51:38.328ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1912024-09-03T23:51:38.391ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1922024-09-03T23:51:38.393ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) } result = Ok(())
1932024-09-03T23:51:38.394ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1942024-09-03T23:51:38.394ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1952024-09-03T23:51:38.419ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1962024-09-03T23:51:38.420ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1972024-09-03T23:51:38.423ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1982024-09-03T23:51:38.424ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1992024-09-03T23:51:38.426ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2002024-09-03T23:51:38.427ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2012024-09-03T23:51:38.429ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2022024-09-03T23:51:38.429ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2032024-09-03T23:51:38.433ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2042024-09-03T23:51:38.434ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2052024-09-03T23:51:38.435ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2062024-09-03T23:51:38.435ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2072024-09-03T23:51:38.436ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2082024-09-03T23:51:38.436ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2092024-09-03T23:51:38.437ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2102024-09-03T23:51:38.440ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
2112024-09-03T23:51:38.440ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2122024-09-03T23:51:38.440ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2132024-09-03T23:51:38.442ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2142024-09-03T23:51:38.442ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2152024-09-03T23:51:38.443ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2162024-09-03T23:51:38.443ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2172024-09-03T23:51:38.445ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2182024-09-03T23:51:38.448ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
2192024-09-03T23:51:38.448ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2202024-09-03T23:51:38.448ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2212024-09-03T23:51:38.512ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2222024-09-03T23:51:38.513ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2232024-09-03T23:51:38.514ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2242024-09-03T23:51:38.515ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2252024-09-03T23:51:38.516ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2262024-09-03T23:51:38.516ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2272024-09-03T23:51:38.518ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2282024-09-03T23:51:38.521ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
2292024-09-03T23:51:38.521ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2302024-09-03T23:51:38.521ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2312024-09-03T23:51:38.557ZDEBGnexus (DataLoader): attempting to create built-in VPC firewall rules
2322024-09-03T23:51:38.557ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2332024-09-03T23:51:38.557ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2342024-09-03T23:51:38.559ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2352024-09-03T23:51:38.559ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2362024-09-03T23:51:38.561ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2372024-09-03T23:51:38.561ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2382024-09-03T23:51:38.562ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2392024-09-03T23:51:38.562ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2402024-09-03T23:51:38.564ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2412024-09-03T23:51:38.564ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2422024-09-03T23:51:38.565ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2432024-09-03T23:51:38.565ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2442024-09-03T23:51:38.566ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2452024-09-03T23:51:38.569ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
2462024-09-03T23:51:38.569ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2472024-09-03T23:51:38.569ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2482024-09-03T23:51:38.570ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2492024-09-03T23:51:38.570ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2502024-09-03T23:51:38.572ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2512024-09-03T23:51:38.572ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2522024-09-03T23:51:38.573ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2532024-09-03T23:51:38.576ZDEBGnexus (DataLoader): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
2542024-09-03T23:51:38.576ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2552024-09-03T23:51:38.576ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2562024-09-03T23:51:38.579ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2572024-09-03T23:51:38.579ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2582024-09-03T23:51:38.581ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2592024-09-03T23:51:38.581ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2602024-09-03T23:51:38.582ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2612024-09-03T23:51:38.582ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2622024-09-03T23:51:38.583ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2632024-09-03T23:51:38.586ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
2642024-09-03T23:51:38.586ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2652024-09-03T23:51:38.586ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2662024-09-03T23:51:38.824ZWARNnexus (datastore): Retryable transaction failure file = nexus/db-queries/src/transaction_retry.rs:160 retry_after (ms) = 33 transaction = vpc_update_firewall_rules
2672024-09-03T23:51:38.873ZINFOnexus (datastore): transaction completed attempts = 2 file = nexus/db-queries/src/transaction_retry.rs:116 transaction = vpc_update_firewall_rules
2682024-09-03T23:51:38.873ZINFOnexus (DataLoader): created built-in VPC firewall rules file = nexus/db-queries/src/db/datastore/vpc.rs:252
2692024-09-03T23:51:38.873ZDEBGnexus (DataLoader): attempting to create built-in VPC Subnets
2702024-09-03T23:51:38.873ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2712024-09-03T23:51:38.874ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2722024-09-03T23:51:38.881ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2732024-09-03T23:51:38.882ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2742024-09-03T23:51:38.882ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2752024-09-03T23:51:38.883ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2762024-09-03T23:51:38.884ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2772024-09-03T23:51:38.884ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2782024-09-03T23:51:38.885ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2792024-09-03T23:51:38.886ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2802024-09-03T23:51:38.887ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2812024-09-03T23:51:38.887ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2822024-09-03T23:51:38.889ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2832024-09-03T23:51:38.891ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
2842024-09-03T23:51:38.891ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2852024-09-03T23:51:38.891ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2862024-09-03T23:51:38.893ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2872024-09-03T23:51:38.893ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2882024-09-03T23:51:38.895ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2892024-09-03T23:51:38.895ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2902024-09-03T23:51:38.896ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2912024-09-03T23:51:38.896ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2922024-09-03T23:51:38.897ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2932024-09-03T23:51:38.897ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2942024-09-03T23:51:38.899ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2952024-09-03T23:51:38.899ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2962024-09-03T23:51:38.900ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2972024-09-03T23:51:38.900ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2982024-09-03T23:51:38.901ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2992024-09-03T23:51:38.904ZDEBGnexus (DataLoader): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ById(001de000-c470-4000-8000-000000000001) } result = Ok(())
3002024-09-03T23:51:38.904ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3012024-09-03T23:51:38.904ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3022024-09-03T23:51:38.906ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3032024-09-03T23:51:38.906ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3042024-09-03T23:51:38.907ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3052024-09-03T23:51:38.908ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3062024-09-03T23:51:38.909ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3072024-09-03T23:51:38.909ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3082024-09-03T23:51:38.910ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3092024-09-03T23:51:38.912ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
3102024-09-03T23:51:38.954ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3112024-09-03T23:51:38.954ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3122024-09-03T23:51:39.029ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3132024-09-03T23:51:39.029ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3142024-09-03T23:51:39.066ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3152024-09-03T23:51:39.066ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3162024-09-03T23:51:39.068ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3172024-09-03T23:51:39.068ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3182024-09-03T23:51:39.069ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3192024-09-03T23:51:39.069ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3202024-09-03T23:51:39.071ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3212024-09-03T23:51:39.073ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
3222024-09-03T23:51:39.073ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3232024-09-03T23:51:39.073ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3242024-09-03T23:51:39.109ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3252024-09-03T23:51:39.110ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3262024-09-03T23:51:39.112ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3272024-09-03T23:51:39.113ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3282024-09-03T23:51:39.114ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3292024-09-03T23:51:39.115ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3302024-09-03T23:51:39.116ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3312024-09-03T23:51:39.116ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3322024-09-03T23:51:39.118ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3332024-09-03T23:51:39.118ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3342024-09-03T23:51:39.119ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3352024-09-03T23:51:39.119ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3362024-09-03T23:51:39.123ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3372024-09-03T23:51:39.123ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3382024-09-03T23:51:39.124ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3392024-09-03T23:51:39.128ZDEBGnexus (DataLoader): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-c470-4000-8000-000000000003, lookup_type: ById(001de000-c470-4000-8000-000000000003) } result = Ok(())
3402024-09-03T23:51:39.128ZINFOnexus (DataLoader): created built-in services vpc subnets file = nexus/db-queries/src/db/datastore/vpc.rs:316
3412024-09-03T23:51:39.128ZINFOnexus (DataLoader): created built-in services vpc file = nexus/db-queries/src/db/datastore/vpc.rs:194
3422024-09-03T23:51:39.128ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3432024-09-03T23:51:39.128ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3442024-09-03T23:51:39.128ZDEBGnexus (DataLoader): attempting to create silo users
3452024-09-03T23:51:39.128ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3462024-09-03T23:51:39.128ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3472024-09-03T23:51:39.131ZINFOnexus (DataLoader): created 2 silo users file = nexus/db-queries/src/db/datastore/silo_user.rs:419
3482024-09-03T23:51:39.131ZDEBGnexus (DataLoader): attempting to create silo user role assignments
3492024-09-03T23:51:39.131ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3502024-09-03T23:51:39.132ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3512024-09-03T23:51:39.136ZINFOnexus (DataLoader): created 2 silo user role assignments file = nexus/db-queries/src/db/datastore/silo_user.rs:446
3522024-09-03T23:51:39.136ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3532024-09-03T23:51:39.136ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3542024-09-03T23:51:39.139ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3552024-09-03T23:51:39.140ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3562024-09-03T23:51:39.158ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3572024-09-03T23:51:39.158ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3582024-09-03T23:51:39.159ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3592024-09-03T23:51:39.160ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = IpPoolList result = Ok(())
3602024-09-03T23:51:39.160ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3612024-09-03T23:51:39.160ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3622024-09-03T23:51:39.164ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3632024-09-03T23:51:39.164ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3642024-09-03T23:51:39.165ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3652024-09-03T23:51:39.166ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = IpPoolList result = Ok(())
3662024-09-03T23:51:39.166ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3672024-09-03T23:51:39.166ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3682024-09-03T23:51:39.240ZINFOnexus: populate complete file = nexus/src/app/mod.rs:513
3692024-09-03T23:51:39.240ZINFOnexus: activating background tasks file = nexus/src/app/mod.rs:522
3702024-09-03T23:51:39.244ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 1 reason = Timeout
3712024-09-03T23:51:39.244ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 1 reason = Timeout
3722024-09-03T23:51:39.244ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 1 reason = Timeout
3732024-09-03T23:51:39.244ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 1 reason = Timeout
3742024-09-03T23:51:39.244ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:71 reason = no blueprint
3752024-09-03T23:51:39.244ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 1 reason = Timeout
3762024-09-03T23:51:39.244ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 1 reason = Timeout
3772024-09-03T23:51:39.244ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 1 reason = Timeout
3782024-09-03T23:51:39.244ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:61 reason = no config nor servers
3792024-09-03T23:51:39.244ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:61 reason = no config nor servers
3802024-09-03T23:51:39.244ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 1 reason = Timeout
3812024-09-03T23:51:39.244ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 1 reason = Timeout
3822024-09-03T23:51:39.244ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 1 reason = Timeout
3832024-09-03T23:51:39.244ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 1 reason = Timeout
3842024-09-03T23:51:39.244ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 1 reason = Timeout
3852024-09-03T23:51:39.244ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 1 reason = Timeout
3862024-09-03T23:51:39.245ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-09-03 23:41:39.244993734 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
3872024-09-03T23:51:39.245ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
3882024-09-03T23:51:39.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3892024-09-03T23:51:39.245ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
3902024-09-03T23:51:39.245ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
3912024-09-03T23:51:39.245ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
3922024-09-03T23:51:39.245ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3932024-09-03T23:51:39.245ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3942024-09-03T23:51:39.245ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 1 reason = Timeout
3952024-09-03T23:51:39.245ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 1 reason = Timeout
3962024-09-03T23:51:39.245ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 1 reason = Timeout
3972024-09-03T23:51:39.245ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 1 reason = Timeout
3982024-09-03T23:51:39.245ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 1 reason = Timeout
3992024-09-03T23:51:39.245ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 1 reason = Timeout
4002024-09-03T23:51:39.245ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 1 reason = Timeout
4012024-09-03T23:51:39.245ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
4022024-09-03T23:51:39.245ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = crdb_node_id_collector file = nexus/src/app/background/tasks/crdb_node_id_collector.rs:78 reason = no blueprint
4032024-09-03T23:51:39.246ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 1.894711ms iteration = 1 status = {"error":"no config nor servers"}
4042024-09-03T23:51:39.247ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 1 reason = Timeout
4052024-09-03T23:51:39.248ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
4062024-09-03T23:51:39.248ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
4072024-09-03T23:51:39.248ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
4082024-09-03T23:51:39.248ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 4.691161ms iteration = 1 status = {"error":"no config nor servers"}
4092024-09-03T23:51:39.249ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 143.543\u{b5}s iteration = 1 status = {"error":"no blueprint"}
4102024-09-03T23:51:39.249ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
4112024-09-03T23:51:39.249ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 3.30254ms iteration = 1 status = {"error":"no blueprint"}
4122024-09-03T23:51:39.249ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
4132024-09-03T23:51:39.249ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4142024-09-03T23:51:39.249ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
4152024-09-03T23:51:39.249ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
4162024-09-03T23:51:39.249ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4172024-09-03T23:51:39.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4182024-09-03T23:51:39.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
4192024-09-03T23:51:39.249ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 1 reason = Timeout
4202024-09-03T23:51:39.249ZINFOnexus (BackgroundTasks): Abandoned VMM reaper running background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:76
4212024-09-03T23:51:39.249ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
4222024-09-03T23:51:39.249ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 1 reason = Timeout
4232024-09-03T23:51:39.249ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 1 reason = Timeout
4242024-09-03T23:51:39.249ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1f2af9fb-1e02-483c-afd2-2b8742b46afd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("90a0c753-ce30-4bd3-a374-17c504cb8aee.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("90a0c753-ce30-4bd3-a374-17c504cb8aee.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1077, tv_nsec: 751599181 } })
4252024-09-03T23:51:39.249ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 1 reason = Timeout
4262024-09-03T23:51:39.249ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 1 reason = Timeout
4272024-09-03T23:51:39.249ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
4282024-09-03T23:51:39.249ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 1 reason = Timeout
4292024-09-03T23:51:39.249ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4302024-09-03T23:51:39.249ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 1 reason = Timeout
4312024-09-03T23:51:39.249ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 1 reason = Timeout
4322024-09-03T23:51:39.249ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 1 reason = Timeout
4332024-09-03T23:51:39.249ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
4342024-09-03T23:51:39.249ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 1 reason = Timeout
4352024-09-03T23:51:39.249ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 1 reason = Timeout
4362024-09-03T23:51:39.249ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4372024-09-03T23:51:39.249ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 1 reason = Timeout
4382024-09-03T23:51:39.249ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
4392024-09-03T23:51:39.249ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
4402024-09-03T23:51:39.249ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
4412024-09-03T23:51:39.249ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
4422024-09-03T23:51:39.249ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("321ab50f-2ef5-4620-bbd0-13eba6f06554.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("32795d59-c08e-49d2-b2b0-79f550835c9d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a7781486-6706-487a-a86f-e75908a89f03.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("a7781486-6706-487a-a86f-e75908a89f03.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1077, tv_nsec: 751973549 } })
4432024-09-03T23:51:39.250ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
4442024-09-03T23:51:39.250ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
4452024-09-03T23:51:39.250ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
4462024-09-03T23:51:39.250ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
4472024-09-03T23:51:39.250ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
4482024-09-03T23:51:39.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
4492024-09-03T23:51:39.251ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
4502024-09-03T23:51:39.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
4512024-09-03T23:51:39.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
4522024-09-03T23:51:39.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
4532024-09-03T23:51:39.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
4542024-09-03T23:51:39.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
4552024-09-03T23:51:39.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
4562024-09-03T23:51:39.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
4572024-09-03T23:51:39.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4582024-09-03T23:51:39.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
4592024-09-03T23:51:39.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
4602024-09-03T23:51:39.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
4612024-09-03T23:51:39.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
4622024-09-03T23:51:39.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
4632024-09-03T23:51:39.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
4642024-09-03T23:51:39.253ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
4652024-09-03T23:51:39.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
4662024-09-03T23:51:39.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
4672024-09-03T23:51:39.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4682024-09-03T23:51:39.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
4692024-09-03T23:51:39.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
4702024-09-03T23:51:39.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4712024-09-03T23:51:39.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
4722024-09-03T23:51:39.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
4732024-09-03T23:51:39.256ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 11.560779ms iteration = 1 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
4742024-09-03T23:51:39.256ZINFOnexus (BackgroundTasks): found DNS servers (initial) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external dns_group = external file = nexus/src/app/background/tasks/dns_servers.rs:113
4752024-09-03T23:51:39.256ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 11.796494ms iteration = 1 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
4762024-09-03T23:51:39.256ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 2 reason = Dependency
4772024-09-03T23:51:39.256ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
4782024-09-03T23:51:39.256ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 6.58\u{b5}s iteration = 2 status = {"error":"no config"}
4792024-09-03T23:51:39.258ZINFOnexus (BackgroundTasks): found DNS servers (initial) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal dns_group = internal file = nexus/src/app/background/tasks/dns_servers.rs:113
4802024-09-03T23:51:39.258ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 14.070703ms iteration = 1 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
4812024-09-03T23:51:39.258ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 2 reason = Dependency
4822024-09-03T23:51:39.258ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
4832024-09-03T23:51:39.258ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 19.98\u{b5}s iteration = 2 status = {"error":"no config"}
4842024-09-03T23:51:39.265ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4852024-09-03T23:51:39.269ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-09-03 23:41:39.244993734 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
4862024-09-03T23:51:39.269ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 24.902917ms iteration = 1 status = {"expiration":"2024-09-03T23:41:39.244993734Z","pruned":[]}
4872024-09-03T23:51:39.270ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
4882024-09-03T23:51:39.270ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4892024-09-03T23:51:39.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4902024-09-03T23:51:39.276ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
4912024-09-03T23:51:39.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
4922024-09-03T23:51:39.276ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
4932024-09-03T23:51:39.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
4942024-09-03T23:51:39.278ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b281022b-35b2-452e-ad2b-78e12f6ca16a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b281022b-35b2-452e-ad2b-78e12f6ca16a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1077, tv_nsec: 780320559 } })
4952024-09-03T23:51:39.279ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
4962024-09-03T23:51:39.281ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4972024-09-03T23:51:39.283ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
4982024-09-03T23:51:39.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
4992024-09-03T23:51:39.284ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
5002024-09-03T23:51:39.284ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5012024-09-03T23:51:39.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5022024-09-03T23:51:39.293ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 43.784443ms iteration = 1 status = {"errors":[],"found_port_ok":[]}
5032024-09-03T23:51:39.319ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b281022b-35b2-452e-ad2b-78e12f6ca16a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b281022b-35b2-452e-ad2b-78e12f6ca16a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1077, tv_nsec: 821883104 } })
5042024-09-03T23:51:39.320ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
5052024-09-03T23:51:39.326ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
5062024-09-03T23:51:39.326ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
5072024-09-03T23:51:39.327ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5082024-09-03T23:51:39.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5092024-09-03T23:51:39.328ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d9c12d80-5753-4d93-8209-4aac851c2c96", "content-length": "26", "date": "Tue, 03 Sep 2024 23:51:39 GMT"} })
5102024-09-03T23:51:39.329ZWARNnexus (BackgroundTasks): failed to read target blueprint background_task = blueprint_loader error = Internal Error: no target blueprint set file = nexus/src/app/background/tasks/blueprint_load.rs:69
5112024-09-03T23:51:39.329ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 84.750815ms iteration = 1 status = {"error":"failed to read target blueprint: Internal Error: no target blueprint set"}
5122024-09-03T23:51:39.334ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
5132024-09-03T23:51:39.335ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
5142024-09-03T23:51:39.340ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5152024-09-03T23:51:39.342ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5162024-09-03T23:51:39.342ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
5172024-09-03T23:51:39.342ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
5182024-09-03T23:51:39.343ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5192024-09-03T23:51:39.344ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
5202024-09-03T23:51:39.344ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
5212024-09-03T23:51:39.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5222024-09-03T23:51:39.345ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5232024-09-03T23:51:39.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5242024-09-03T23:51:39.346ZWARNnexus (BackgroundTasks): inventory collection is None background_task = service_zone_nat_tracker file = nexus/src/app/background/tasks/sync_service_zone_nat.rs:95
5252024-09-03T23:51:39.346ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 101.23399ms iteration = 1 status = {"error":"inventory collection is None"}
5262024-09-03T23:51:39.347ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 97.867878ms iteration = 1 status = {"errors":[],"records_set_to_done":[]}
5272024-09-03T23:51:39.349ZINFOnexus (BackgroundTasks): Physical Disk Adoption: Rack not yet initialized background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:79 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df
5282024-09-03T23:51:39.349ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 104.218785ms iteration = 1 status = {"error":"rack not yet initialized: 1d4636f4-828e-412a-8daf-3bda355c92df"}
5292024-09-03T23:51:39.351ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5302024-09-03T23:51:39.352ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5312024-09-03T23:51:39.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5322024-09-03T23:51:39.353ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
5332024-09-03T23:51:39.353ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
5342024-09-03T23:51:39.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
5352024-09-03T23:51:39.357ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5362024-09-03T23:51:39.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5372024-09-03T23:51:39.358ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
5382024-09-03T23:51:39.358ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5392024-09-03T23:51:39.360ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5402024-09-03T23:51:39.360ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5412024-09-03T23:51:39.362ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
5422024-09-03T23:51:39.362ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5432024-09-03T23:51:39.362ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5442024-09-03T23:51:39.364ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:438
5452024-09-03T23:51:39.364ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 114.68061ms iteration = 1 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":0,"recent_failures":[],"recent_recoveries":[]}
5462024-09-03T23:51:39.364ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
5472024-09-03T23:51:39.364ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
5482024-09-03T23:51:39.365ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5492024-09-03T23:51:39.365ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5502024-09-03T23:51:39.366ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5512024-09-03T23:51:39.366ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5522024-09-03T23:51:39.367ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5532024-09-03T23:51:39.368ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
5542024-09-03T23:51:39.368ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5552024-09-03T23:51:39.369ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5562024-09-03T23:51:39.369ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
5572024-09-03T23:51:39.369ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
5582024-09-03T23:51:39.369ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
5592024-09-03T23:51:39.370ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5602024-09-03T23:51:39.370ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
5612024-09-03T23:51:39.370ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
5622024-09-03T23:51:39.373ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
5632024-09-03T23:51:39.373ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5642024-09-03T23:51:39.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5652024-09-03T23:51:39.374ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5662024-09-03T23:51:39.375ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5672024-09-03T23:51:39.376ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 130.277366ms iteration = 1 status = {}
5682024-09-03T23:51:39.376ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
5692024-09-03T23:51:39.376ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
5702024-09-03T23:51:39.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
5712024-09-03T23:51:39.378ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5722024-09-03T23:51:39.378ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
5732024-09-03T23:51:39.378ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5742024-09-03T23:51:39.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5752024-09-03T23:51:39.380ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 131.341208ms iteration = 1 status = {"errors":[],"garbage_collect_requested":[]}
5762024-09-03T23:51:39.381ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
5772024-09-03T23:51:39.382ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5782024-09-03T23:51:39.385ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
5792024-09-03T23:51:39.387ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5802024-09-03T23:51:39.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5812024-09-03T23:51:39.391ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
5822024-09-03T23:51:39.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
5832024-09-03T23:51:39.391ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 141.806954ms iteration = 1 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
5842024-09-03T23:51:39.394ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:56
5852024-09-03T23:51:39.394ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
5862024-09-03T23:51:39.394ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
5872024-09-03T23:51:39.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
5882024-09-03T23:51:39.399ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5892024-09-03T23:51:39.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5902024-09-03T23:51:39.403ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
5912024-09-03T23:51:39.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
5922024-09-03T23:51:39.403ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5932024-09-03T23:51:39.405ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = []
5942024-09-03T23:51:39.405ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-b281022b-35b2-452e-ad2b-78e12f6ca16a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b281022b-35b2-452e-ad2b-78e12f6ca16a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1077, tv_nsec: 907878386 } })
5952024-09-03T23:51:39.408ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
5962024-09-03T23:51:39.408ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
5972024-09-03T23:51:39.408ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
5982024-09-03T23:51:39.408ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5992024-09-03T23:51:39.408ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6002024-09-03T23:51:39.412ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
6012024-09-03T23:51:39.412ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
6022024-09-03T23:51:39.412ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 162.640103ms iteration = 1 status = {"error":null,"error_count":0,"found":0,"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0}
6032024-09-03T23:51:39.414ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
6042024-09-03T23:51:39.416ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6f06f61e-1c85-4842-ab80-5e1ea7a85381", "content-length": "1", "date": "Tue, 03 Sep 2024 23:51:39 GMT"} })
6052024-09-03T23:51:39.418ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "285a9805-2714-4a00-bb12-5b5ab62c0dbc", "content-length": "26", "date": "Tue, 03 Sep 2024 23:51:39 GMT"} })
6062024-09-03T23:51:39.418ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
6072024-09-03T23:51:39.419ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6082024-09-03T23:51:39.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6092024-09-03T23:51:39.420ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
6102024-09-03T23:51:39.420ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
6112024-09-03T23:51:39.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
6122024-09-03T23:51:39.422ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6132024-09-03T23:51:39.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6142024-09-03T23:51:39.423ZWARNnexus (BackgroundTasks): failed to read Silo/DNS/TLS configuration background_task = external_endpoints error = Internal Error: expected at least one external DNS zone file = nexus/src/app/background/tasks/external_endpoints.rs:48
6152024-09-03T23:51:39.423ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 179.452874ms iteration = 1 status = {"error":"failed to read Silo/DNS/TLS configuration: Internal Error: expected at least one external DNS zone"}
6162024-09-03T23:51:39.425ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6172024-09-03T23:51:39.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6182024-09-03T23:51:39.426ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 182.609502ms iteration = 1 status = null
6192024-09-03T23:51:39.427ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6202024-09-03T23:51:39.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6212024-09-03T23:51:39.429ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6222024-09-03T23:51:39.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6232024-09-03T23:51:39.431ZWARNnexus (BackgroundTasks): failed to read DNS config background_task = dns_config_external dns_group = external error = Internal Error: expected exactly one latest version for DNS group External, found 0 file = nexus/src/app/background/tasks/dns_config.rs:72
6242024-09-03T23:51:39.431ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 187.216282ms iteration = 1 status = {"error":"failed to read DNS config: Internal Error: expected exactly one latest version for DNS group External, found 0"}
6252024-09-03T23:51:39.435ZWARNnexus (BackgroundTasks): failed to read DNS config background_task = dns_config_internal dns_group = internal error = Internal Error: expected exactly one latest version for DNS group Internal, found 0 file = nexus/src/app/background/tasks/dns_config.rs:72
6262024-09-03T23:51:39.435ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 190.652765ms iteration = 1 status = {"error":"failed to read DNS config: Internal Error: expected exactly one latest version for DNS group Internal, found 0"}
6272024-09-03T23:51:39.438ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6282024-09-03T23:51:39.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6292024-09-03T23:51:39.443ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6302024-09-03T23:51:39.446ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
6312024-09-03T23:51:39.446ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
6322024-09-03T23:51:39.446ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 201.06821ms iteration = 1 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
6332024-09-03T23:51:39.448ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
6342024-09-03T23:51:39.448ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6352024-09-03T23:51:39.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6362024-09-03T23:51:39.450ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:56
6372024-09-03T23:51:39.450ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
6382024-09-03T23:51:39.450ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
6392024-09-03T23:51:39.450ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6402024-09-03T23:51:39.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
6412024-09-03T23:51:39.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6422024-09-03T23:51:39.453ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6432024-09-03T23:51:39.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6442024-09-03T23:51:39.456ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6452024-09-03T23:51:39.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6462024-09-03T23:51:39.459ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 213.400886ms iteration = 1 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
6472024-09-03T23:51:39.459ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
6482024-09-03T23:51:39.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
6492024-09-03T23:51:39.459ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6502024-09-03T23:51:39.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6512024-09-03T23:51:39.462ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6522024-09-03T23:51:39.462ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6532024-09-03T23:51:39.464ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 214.480739ms iteration = 1 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
6542024-09-03T23:51:39.464ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
6552024-09-03T23:51:39.464ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
6562024-09-03T23:51:39.464ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
6572024-09-03T23:51:39.466ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/ignition", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "4dbd725f-4de1-4ca0-a4e5-04d702e42620", "content-length": "476", "date": "Tue, 03 Sep 2024 23:51:39 GMT"} })
6582024-09-03T23:51:39.469ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 219.544938ms iteration = 1 status = {}
6592024-09-03T23:51:39.469ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 225.560517ms iteration = 1 status = {}
6602024-09-03T23:51:39.470ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
6612024-09-03T23:51:39.471ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a6ec81ba-2ccb-49cd-a1dc-42e8a5459928", "content-length": "734", "date": "Tue, 03 Sep 2024 23:51:39 GMT"} })
6622024-09-03T23:51:39.473ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
6632024-09-03T23:51:39.473ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
6642024-09-03T23:51:39.474ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
6652024-09-03T23:51:39.474ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/sp/caboose", query: Some("firmware_slot=0"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "176902f5-7c38-4315-b1b0-ead64937581b", "content-length": "86", "date": "Tue, 03 Sep 2024 23:51:39 GMT"} })
6662024-09-03T23:51:39.474ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
6672024-09-03T23:51:39.475ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/sp/caboose", query: Some("firmware_slot=1"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "2c846336-217c-4502-88b5-87106205cef3", "content-length": "86", "date": "Tue, 03 Sep 2024 23:51:39 GMT"} })
6682024-09-03T23:51:39.475ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
6692024-09-03T23:51:39.475ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/rot/caboose", query: Some("firmware_slot=0"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c25ef172-b0fa-4aff-939f-f1cfe985f5e5", "content-length": "80", "date": "Tue, 03 Sep 2024 23:51:39 GMT"} })
6702024-09-03T23:51:39.475ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
6712024-09-03T23:51:39.475ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/rot/caboose", query: Some("firmware_slot=1"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "78a76f4d-c868-473d-9e80-fe8a18315820", "content-length": "80", "date": "Tue, 03 Sep 2024 23:51:39 GMT"} })
6722024-09-03T23:51:39.475ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
6732024-09-03T23:51:39.476ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/stage0/caboose", query: Some("firmware_slot=0"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "45d952bd-719a-41d6-8c0d-eb61a0d1137b", "content-length": "88", "date": "Tue, 03 Sep 2024 23:51:39 GMT"} })
6742024-09-03T23:51:39.476ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
6752024-09-03T23:51:39.476ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/stage0/caboose", query: Some("firmware_slot=1"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "7905edcd-47f4-43fb-9671-3be6b2a44a35", "content-length": "88", "date": "Tue, 03 Sep 2024 23:51:39 GMT"} })
6762024-09-03T23:51:39.476ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
6772024-09-03T23:51:39.476ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/rot/cmpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "4743ff06-0d35-4cfe-9e18-d1e0b496dfc1", "content-length": "702", "date": "Tue, 03 Sep 2024 23:51:39 GMT"} })
6782024-09-03T23:51:39.479ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
6792024-09-03T23:51:39.479ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/rot/cfpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "11999ee5-aa4a-45b1-8b87-0fc2016b7a84", "content-length": "727", "date": "Tue, 03 Sep 2024 23:51:39 GMT"} })
6802024-09-03T23:51:39.479ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
6812024-09-03T23:51:39.479ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/rot/cfpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "5f3f3575-722a-4f25-bb7d-a2c74891e531", "content-length": "729", "date": "Tue, 03 Sep 2024 23:51:39 GMT"} })
6822024-09-03T23:51:39.479ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
6832024-09-03T23:51:39.481ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/rot/cfpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "4ea6020d-dfa4-45a2-98cf-50d13155017e", "content-length": "728", "date": "Tue, 03 Sep 2024 23:51:39 GMT"} })
6842024-09-03T23:51:39.481ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
6852024-09-03T23:51:39.482ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "56f55719-8754-466b-8e66-38776c60c471", "content-length": "722", "date": "Tue, 03 Sep 2024 23:51:39 GMT"} })
6862024-09-03T23:51:39.482ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
6872024-09-03T23:51:39.482ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/sp/caboose", query: Some("firmware_slot=0"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "28a2b0eb-f70d-4328-bdcf-12f52db301c9", "content-length": "84", "date": "Tue, 03 Sep 2024 23:51:39 GMT"} })
6882024-09-03T23:51:39.482ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
6892024-09-03T23:51:39.483ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/sp/caboose", query: Some("firmware_slot=1"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "54d17c08-3d49-4e53-82f8-0ad0197a653c", "content-length": "84", "date": "Tue, 03 Sep 2024 23:51:39 GMT"} })
6902024-09-03T23:51:39.483ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
6912024-09-03T23:51:39.483ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/rot/caboose", query: Some("firmware_slot=0"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "19e64d13-401d-4628-9d61-f08cbac89a01", "content-length": "82", "date": "Tue, 03 Sep 2024 23:51:39 GMT"} })
6922024-09-03T23:51:39.483ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
6932024-09-03T23:51:39.483ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/rot/caboose", query: Some("firmware_slot=1"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "4ec04a61-d493-426a-a1c7-707a7f1ba82d", "content-length": "82", "date": "Tue, 03 Sep 2024 23:51:39 GMT"} })
6942024-09-03T23:51:39.483ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
6952024-09-03T23:51:39.485ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/stage0/caboose", query: Some("firmware_slot=0"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e41efb4f-3f9f-4eb1-b7ea-1728749730b3", "content-length": "91", "date": "Tue, 03 Sep 2024 23:51:39 GMT"} })
6962024-09-03T23:51:39.485ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
6972024-09-03T23:51:39.485ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/stage0/caboose", query: Some("firmware_slot=1"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "5496f714-8b53-40a4-9f7b-ec4a6d8de98f", "content-length": "91", "date": "Tue, 03 Sep 2024 23:51:39 GMT"} })
6982024-09-03T23:51:39.485ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
6992024-09-03T23:51:39.485ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/rot/cmpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "67324251-aecb-4dc3-b4d0-4cdd10a56e52", "content-length": "702", "date": "Tue, 03 Sep 2024 23:51:39 GMT"} })
7002024-09-03T23:51:39.485ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
7012024-09-03T23:51:39.485ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/rot/cfpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6f3bb380-70cb-4745-affc-7c5a29094547", "content-length": "727", "date": "Tue, 03 Sep 2024 23:51:39 GMT"} })
7022024-09-03T23:51:39.485ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
7032024-09-03T23:51:39.485ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/rot/cfpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "31f645f6-f1b4-425d-b307-c1618ab09232", "content-length": "729", "date": "Tue, 03 Sep 2024 23:51:39 GMT"} })
7042024-09-03T23:51:39.485ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
7052024-09-03T23:51:39.486ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/rot/cfpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "63fa4d8f-7963-4965-9511-b9a01ec0f4d5", "content-length": "728", "date": "Tue, 03 Sep 2024 23:51:39 GMT"} })
7062024-09-03T23:51:39.486ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
7072024-09-03T23:51:39.486ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
7082024-09-03T23:51:39.497ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7092024-09-03T23:51:39.498ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
7102024-09-03T23:51:39.498ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
7112024-09-03T23:51:39.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
7122024-09-03T23:51:39.500ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7132024-09-03T23:51:39.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7142024-09-03T23:51:39.500ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7152024-09-03T23:51:39.501ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7162024-09-03T23:51:39.502ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 252.933507ms iteration = 1 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
7172024-09-03T23:51:39.502ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
7182024-09-03T23:51:39.502ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
7192024-09-03T23:51:39.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
7202024-09-03T23:51:39.506ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
7212024-09-03T23:51:39.506ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7222024-09-03T23:51:39.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7232024-09-03T23:51:39.507ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:56
7242024-09-03T23:51:39.507ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:241 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
7252024-09-03T23:51:39.507ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 257.857593ms iteration = 1 status = {"destroyed_active_vmms":0,"error":null,"failed_active_vmms":0,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
7262024-09-03T23:51:39.508ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7272024-09-03T23:51:39.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7282024-09-03T23:51:39.509ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7292024-09-03T23:51:39.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7302024-09-03T23:51:39.511ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7312024-09-03T23:51:39.514ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
7322024-09-03T23:51:39.514ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7332024-09-03T23:51:39.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7342024-09-03T23:51:39.520ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7352024-09-03T23:51:39.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7362024-09-03T23:51:39.521ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7372024-09-03T23:51:39.524ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
7382024-09-03T23:51:39.524ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7392024-09-03T23:51:39.524ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7402024-09-03T23:51:39.525ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7412024-09-03T23:51:39.528ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
7422024-09-03T23:51:39.528ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7432024-09-03T23:51:39.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7442024-09-03T23:51:39.531ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7452024-09-03T23:51:39.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7462024-09-03T23:51:39.532ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:480 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
7472024-09-03T23:51:39.532ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 282.428023ms iteration = 1 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
7482024-09-03T23:51:39.533ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7492024-09-03T23:51:39.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7502024-09-03T23:51:39.535ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7512024-09-03T23:51:39.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7522024-09-03T23:51:39.538ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7532024-09-03T23:51:39.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7542024-09-03T23:51:39.545ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7552024-09-03T23:51:39.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7562024-09-03T23:51:39.573ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
7572024-09-03T23:51:39.573ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
7582024-09-03T23:51:39.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
7592024-09-03T23:51:39.575ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7602024-09-03T23:51:39.577ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
7612024-09-03T23:51:39.581ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
7622024-09-03T23:51:39.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
7632024-09-03T23:51:39.582ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7642024-09-03T23:51:39.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7652024-09-03T23:51:39.584ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7662024-09-03T23:51:39.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7672024-09-03T23:51:39.585ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7682024-09-03T23:51:39.588ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
7692024-09-03T23:51:39.588ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7702024-09-03T23:51:39.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7712024-09-03T23:51:39.590ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7722024-09-03T23:51:39.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7732024-09-03T23:51:39.592ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7742024-09-03T23:51:39.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7752024-09-03T23:51:39.595ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 349.543118ms iteration = 1 status = {}
7762024-09-03T23:51:39.619ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7772024-09-03T23:51:39.623ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
7782024-09-03T23:51:39.623ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7792024-09-03T23:51:39.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7802024-09-03T23:51:39.631ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
7812024-09-03T23:51:39.631ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7822024-09-03T23:51:39.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7832024-09-03T23:51:39.632ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7842024-09-03T23:51:39.636ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
7852024-09-03T23:51:39.636ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7862024-09-03T23:51:39.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7872024-09-03T23:51:39.638ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
7882024-09-03T23:51:39.638ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = []
7892024-09-03T23:51:39.638ZDEBGnexus (service-firewall-rule-progator): resolved 0 rules for sleds background_task = service_firewall_rule_propagation
7902024-09-03T23:51:39.757ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = []
7912024-09-03T23:51:39.757ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
7922024-09-03T23:51:39.757ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 0 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
7932024-09-03T23:51:39.757ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 507.557501ms
7942024-09-03T23:51:39.757ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 507.587131ms iteration = 1 status = {}
7952024-09-03T23:51:39.807ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = d09b57f6-86bc-43ea-9511-542d8a246bfd file = nexus/db-queries/src/db/datastore/inventory.rs:893
7962024-09-03T23:51:39.809ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = d09b57f6-86bc-43ea-9511-542d8a246bfd time_started = 2024-09-03 23:51:39.464197 UTC
7972024-09-03T23:51:39.809ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 563.463864ms iteration = 1 status = {"collection_id":"d09b57f6-86bc-43ea-9511-542d8a246bfd","time_done":"2024-09-03 23:51:39.573886 UTC","time_started":"2024-09-03 23:51:39.464197 UTC"}
7982024-09-03T23:51:39.809ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 2 reason = Dependency
7992024-09-03T23:51:39.809ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
8002024-09-03T23:51:39.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
8012024-09-03T23:51:39.811ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8022024-09-03T23:51:39.813ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
8032024-09-03T23:51:39.813ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
8042024-09-03T23:51:39.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
8052024-09-03T23:51:39.815ZINFOnexus (BackgroundTasks): Physical Disk Adoption: Rack not yet initialized background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:79 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df
8062024-09-03T23:51:39.815ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 5.999789ms iteration = 2 status = {"error":"rack not yet initialized: 1d4636f4-828e-412a-8daf-3bda355c92df"}
8072024-09-03T23:51:39.858ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:42971
8082024-09-03T23:51:39.859ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42971 req_id = 0b298cb8-443e-48d1-b1f2-2274157925a7 roles = RoleSet { roles: {} } uri = /sled-agents/b281022b-35b2-452e-ad2b-78e12f6ca16a
8092024-09-03T23:51:39.859ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42971 req_id = 0b298cb8-443e-48d1-b1f2-2274157925a7 resource = Database result = Ok(()) uri = /sled-agents/b281022b-35b2-452e-ad2b-78e12f6ca16a
8102024-09-03T23:51:39.864ZINFOnexus (dropshot_internal): request completed error_message_external = not found: sled with id "b281022b-35b2-452e-ad2b-78e12f6ca16a" error_message_internal = not found: sled with id "b281022b-35b2-452e-ad2b-78e12f6ca16a" file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:902 latency_us = 5229 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42971 req_id = 0b298cb8-443e-48d1-b1f2-2274157925a7 response_code = 404 uri = /sled-agents/b281022b-35b2-452e-ad2b-78e12f6ca16a
8112024-09-03T23:51:39.865ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42971 req_id = c248c6f9-9d9d-471d-842e-431fd8e86512 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
8122024-09-03T23:51:39.865ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42971 req_id = c248c6f9-9d9d-471d-842e-431fd8e86512 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
8132024-09-03T23:51:39.867ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3170 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42971 req_id = c248c6f9-9d9d-471d-842e-431fd8e86512 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
8142024-09-03T23:51:39.991ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8152024-09-03T23:51:39.991ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8162024-09-03T23:51:39.993ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8172024-09-03T23:51:39.993ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8182024-09-03T23:51:39.994ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8192024-09-03T23:51:39.997ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 1d4636f4-828e-412a-8daf-3bda355c92df, lookup_type: ById(1d4636f4-828e-412a-8daf-3bda355c92df) } result = Ok(())
8202024-09-03T23:51:39.997ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 1d4636f4-828e-412a-8daf-3bda355c92df, time_created: 2024-09-03T23:51:39.139957Z, time_modified: 2024-09-03T23:51:39.139957Z }, initialized: false, tuf_base_url: None, rack_subnet: None } file = nexus/src/app/rack.rs:765
8212024-09-03T23:51:40.189ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:50060
8222024-09-03T23:51:40.190ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50060 req_id = c20d7d39-007c-4e4c-8daa-bc4b194cb25a roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
8232024-09-03T23:51:40.191ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50060 req_id = c20d7d39-007c-4e4c-8daa-bc4b194cb25a resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
8242024-09-03T23:51:40.207ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 16655 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50060 req_id = c20d7d39-007c-4e4c-8daa-bc4b194cb25a response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
8252024-09-03T23:51:40.210ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50060 req_id = 5c8a1a0a-ee68-4069-b324-8437d14930a9 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
8262024-09-03T23:51:40.211ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50060 req_id = 5c8a1a0a-ee68-4069-b324-8437d14930a9 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
8272024-09-03T23:51:40.222ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 12095 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50060 req_id = 5c8a1a0a-ee68-4069-b324-8437d14930a9 response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
8282024-09-03T23:51:40.223ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50060 req_id = a9d99815-83a0-45b3-9e10-7fd356dff4b1 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
8292024-09-03T23:51:40.223ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50060 req_id = a9d99815-83a0-45b3-9e10-7fd356dff4b1 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
8302024-09-03T23:51:40.233ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 10264 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50060 req_id = a9d99815-83a0-45b3-9e10-7fd356dff4b1 response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
8312024-09-03T23:51:40.233ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50060 req_id = 03347415-5eed-49b6-9414-4c81b7e9c463 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
8322024-09-03T23:51:40.233ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50060 req_id = 03347415-5eed-49b6-9414-4c81b7e9c463 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
8332024-09-03T23:51:40.250ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 17199 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50060 req_id = 03347415-5eed-49b6-9414-4c81b7e9c463 response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
8342024-09-03T23:51:40.250ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50060 req_id = 78f4cf25-6efc-4d00-9353-e52a693cc698 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
8352024-09-03T23:51:40.251ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50060 req_id = 78f4cf25-6efc-4d00-9353-e52a693cc698 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
8362024-09-03T23:51:40.275ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 24854 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50060 req_id = 78f4cf25-6efc-4d00-9353-e52a693cc698 response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
8372024-09-03T23:51:40.275ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50060 req_id = 9f0722d2-3ab8-418a-b544-8092fa84fde2 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
8382024-09-03T23:51:40.276ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50060 req_id = 9f0722d2-3ab8-418a-b544-8092fa84fde2 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
8392024-09-03T23:51:40.277ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2083 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50060 req_id = 9f0722d2-3ab8-418a-b544-8092fa84fde2 response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
8402024-09-03T23:51:40.278ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50060 req_id = 07e94fee-97af-44e2-a355-bb765a46d048 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
8412024-09-03T23:51:40.278ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50060 req_id = 07e94fee-97af-44e2-a355-bb765a46d048 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
8422024-09-03T23:51:40.280ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2319 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50060 req_id = 07e94fee-97af-44e2-a355-bb765a46d048 response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
8432024-09-03T23:51:40.891ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42971 req_id = f4fb0ae1-362b-479f-ad4a-a1bc4d7c1cfa roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
8442024-09-03T23:51:40.891ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42971 req_id = f4fb0ae1-362b-479f-ad4a-a1bc4d7c1cfa resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
8452024-09-03T23:51:40.892ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1518 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42971 req_id = f4fb0ae1-362b-479f-ad4a-a1bc4d7c1cfa response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
8462024-09-03T23:51:41.228ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:49121
8472024-09-03T23:51:41.530ZINFOnexus: registered sled agent file = nexus/src/app/sled.rs:53 sled_uuid = b281022b-35b2-452e-ad2b-78e12f6ca16a
8482024-09-03T23:51:41.551ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 23497 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 26705aa7-f937-48e9-953c-72336df5b1b5 response_code = 204 uri = /sled-agents/b281022b-35b2-452e-ad2b-78e12f6ca16a
8492024-09-03T23:51:41.551ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 2 reason = Signaled
8502024-09-03T23:51:41.551ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
8512024-09-03T23:51:41.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
8522024-09-03T23:51:41.553ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8532024-09-03T23:51:41.555ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
8542024-09-03T23:51:41.555ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
8552024-09-03T23:51:41.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
8562024-09-03T23:51:41.559ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(c8244fb8-7917-4fc1-94b3-78021c46d99f, 0), (d09b57f6-86bc-43ea-9511-542d8a246bfd, 0), (088892d9-285f-43c2-a99c-719c2d415beb, 0)]
8572024-09-03T23:51:41.560ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-b281022b-35b2-452e-ad2b-78e12f6ca16a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b281022b-35b2-452e-ad2b-78e12f6ca16a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1080, tv_nsec: 62778162 } })
8582024-09-03T23:51:41.592ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
8592024-09-03T23:51:41.592ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
8602024-09-03T23:51:41.592ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
8612024-09-03T23:51:41.593ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/ignition", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "eb3da5bf-fdfd-4c3d-a975-7744c2e3d9bf", "content-length": "476", "date": "Tue, 03 Sep 2024 23:51:41 GMT"} })
8622024-09-03T23:51:41.593ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
8632024-09-03T23:51:41.593ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "afac99c8-ef01-4c53-9485-84f642231128", "content-length": "734", "date": "Tue, 03 Sep 2024 23:51:41 GMT"} })
8642024-09-03T23:51:41.593ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
8652024-09-03T23:51:41.593ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/sp/caboose", query: Some("firmware_slot=0"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f9c1f74f-4d18-4f54-b782-0ad5ba32995a", "content-length": "86", "date": "Tue, 03 Sep 2024 23:51:41 GMT"} })
8662024-09-03T23:51:41.593ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
8672024-09-03T23:51:41.594ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/sp/caboose", query: Some("firmware_slot=1"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "2c1cf409-e134-4b8d-ad74-4dcf7d8b9601", "content-length": "86", "date": "Tue, 03 Sep 2024 23:51:41 GMT"} })
8682024-09-03T23:51:41.594ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
8692024-09-03T23:51:41.594ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/rot/caboose", query: Some("firmware_slot=0"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "2253ded4-2c2e-4fac-84df-0bef1cab592f", "content-length": "80", "date": "Tue, 03 Sep 2024 23:51:41 GMT"} })
8702024-09-03T23:51:41.594ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
8712024-09-03T23:51:41.595ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/rot/caboose", query: Some("firmware_slot=1"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "36da51bc-bcd4-42ce-b75a-c8d9dad2a55c", "content-length": "80", "date": "Tue, 03 Sep 2024 23:51:41 GMT"} })
8722024-09-03T23:51:41.595ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
8732024-09-03T23:51:41.595ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/stage0/caboose", query: Some("firmware_slot=0"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "12366c13-3d58-4db5-9772-2051b180433a", "content-length": "88", "date": "Tue, 03 Sep 2024 23:51:41 GMT"} })
8742024-09-03T23:51:41.595ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
8752024-09-03T23:51:41.595ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/stage0/caboose", query: Some("firmware_slot=1"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "00461df6-55e6-45af-929f-fe9bf6b71def", "content-length": "88", "date": "Tue, 03 Sep 2024 23:51:41 GMT"} })
8762024-09-03T23:51:41.595ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
8772024-09-03T23:51:41.595ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/rot/cmpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c11724dd-b7d4-457a-869e-3b9c503ac8e5", "content-length": "702", "date": "Tue, 03 Sep 2024 23:51:41 GMT"} })
8782024-09-03T23:51:41.595ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
8792024-09-03T23:51:41.595ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/rot/cfpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e8807dd9-a63d-47b4-b4e2-72ccc94adf7f", "content-length": "727", "date": "Tue, 03 Sep 2024 23:51:41 GMT"} })
8802024-09-03T23:51:41.595ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
8812024-09-03T23:51:41.596ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/rot/cfpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "62475052-aea0-4b6b-940e-00c089c36016", "content-length": "729", "date": "Tue, 03 Sep 2024 23:51:41 GMT"} })
8822024-09-03T23:51:41.596ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
8832024-09-03T23:51:41.596ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/rot/cfpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f2adf432-2991-4d95-86ce-281f3ae43aa2", "content-length": "728", "date": "Tue, 03 Sep 2024 23:51:41 GMT"} })
8842024-09-03T23:51:41.596ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
8852024-09-03T23:51:41.596ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6e399108-7c4e-4bf4-9f8c-d7b8920d20f3", "content-length": "722", "date": "Tue, 03 Sep 2024 23:51:41 GMT"} })
8862024-09-03T23:51:41.596ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
8872024-09-03T23:51:41.597ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/sp/caboose", query: Some("firmware_slot=0"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ddf292dc-08ae-4a3e-9b7b-1bfcd185e76a", "content-length": "84", "date": "Tue, 03 Sep 2024 23:51:41 GMT"} })
8882024-09-03T23:51:41.597ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
8892024-09-03T23:51:41.597ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/sp/caboose", query: Some("firmware_slot=1"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "95ae15e9-e783-4cb6-8200-0c9a43cc85f2", "content-length": "84", "date": "Tue, 03 Sep 2024 23:51:41 GMT"} })
8902024-09-03T23:51:41.597ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
8912024-09-03T23:51:41.597ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/rot/caboose", query: Some("firmware_slot=0"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "92952ce7-2829-4f3e-959d-78d6d3ee784b", "content-length": "82", "date": "Tue, 03 Sep 2024 23:51:41 GMT"} })
8922024-09-03T23:51:41.597ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
8932024-09-03T23:51:41.597ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/rot/caboose", query: Some("firmware_slot=1"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b65429b9-5f39-4f88-a63d-aff7a20ab03a", "content-length": "82", "date": "Tue, 03 Sep 2024 23:51:41 GMT"} })
8942024-09-03T23:51:41.597ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
8952024-09-03T23:51:41.598ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/stage0/caboose", query: Some("firmware_slot=0"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "5871881c-d76e-4539-9629-02be5d118a06", "content-length": "91", "date": "Tue, 03 Sep 2024 23:51:41 GMT"} })
8962024-09-03T23:51:41.598ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
8972024-09-03T23:51:41.598ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/stage0/caboose", query: Some("firmware_slot=1"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "8efa3aa2-215f-431e-af24-8f192cdc5199", "content-length": "91", "date": "Tue, 03 Sep 2024 23:51:41 GMT"} })
8982024-09-03T23:51:41.598ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
8992024-09-03T23:51:41.598ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/rot/cmpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b50aadd3-1d61-4ffe-9143-ce008a32f6c6", "content-length": "702", "date": "Tue, 03 Sep 2024 23:51:41 GMT"} })
9002024-09-03T23:51:41.598ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
9012024-09-03T23:51:41.598ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/rot/cfpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "475a3fb4-b2a3-4ee1-a6c0-bde0de301f85", "content-length": "727", "date": "Tue, 03 Sep 2024 23:51:41 GMT"} })
9022024-09-03T23:51:41.598ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
9032024-09-03T23:51:41.599ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/rot/cfpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "5187ec83-490b-4daa-aa53-7cbd06ede593", "content-length": "729", "date": "Tue, 03 Sep 2024 23:51:41 GMT"} })
9042024-09-03T23:51:41.599ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
9052024-09-03T23:51:41.599ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/rot/cfpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "600123e0-19c3-4aa8-ac2e-6e552196a8d5", "content-length": "728", "date": "Tue, 03 Sep 2024 23:51:41 GMT"} })
9062024-09-03T23:51:41.599ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
9072024-09-03T23:51:41.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
9082024-09-03T23:51:41.601ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9092024-09-03T23:51:41.603ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
9102024-09-03T23:51:41.603ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
9112024-09-03T23:51:41.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
9122024-09-03T23:51:41.605ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9132024-09-03T23:51:41.606ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
9142024-09-03T23:51:41.606ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
9152024-09-03T23:51:41.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
9162024-09-03T23:51:41.640ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
9172024-09-03T23:51:41.640ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
9182024-09-03T23:51:41.727ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/inventory", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "7bbbfec6-56bb-46a3-8219-abe520c53f56", "content-length": "2362", "date": "Tue, 03 Sep 2024 23:51:41 GMT"} })
9192024-09-03T23:51:41.727ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/omicron-zones
9202024-09-03T23:51:41.728ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/omicron-zones", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ae3d0f47-1a54-4755-9619-f9600745aaef", "content-length": "10314", "date": "Tue, 03 Sep 2024 23:51:41 GMT"} })
9212024-09-03T23:51:41.729ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
9222024-09-03T23:51:41.729ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
9232024-09-03T23:51:41.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
9242024-09-03T23:51:41.731ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9252024-09-03T23:51:41.733ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
9262024-09-03T23:51:41.735ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
9272024-09-03T23:51:41.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
9282024-09-03T23:51:41.885ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = d21e6a8f-356f-4d89-a3d3-d2efa1a863cf file = nexus/db-queries/src/db/datastore/inventory.rs:893
9292024-09-03T23:51:41.886ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = d21e6a8f-356f-4d89-a3d3-d2efa1a863cf time_started = 2024-09-03 23:51:41.592280 UTC
9302024-09-03T23:51:41.886ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 334.794369ms iteration = 2 status = {"collection_id":"d21e6a8f-356f-4d89-a3d3-d2efa1a863cf","time_done":"2024-09-03 23:51:41.729517 UTC","time_started":"2024-09-03 23:51:41.592280 UTC"}
9312024-09-03T23:51:41.886ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 3 reason = Dependency
9322024-09-03T23:51:41.886ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
9332024-09-03T23:51:41.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
9342024-09-03T23:51:41.888ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9352024-09-03T23:51:41.889ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
9362024-09-03T23:51:41.889ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
9372024-09-03T23:51:41.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
9382024-09-03T23:51:41.891ZINFOnexus (BackgroundTasks): Physical Disk Adoption: Rack not yet initialized background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:79 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df
9392024-09-03T23:51:41.891ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 5.457098ms iteration = 3 status = {"error":"rack not yet initialized: 1d4636f4-828e-412a-8daf-3bda355c92df"}
9402024-09-03T23:51:41.910ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 36436d34-d1c3-4aae-80db-b0ebac5b0eb2 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
9412024-09-03T23:51:41.910ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 36436d34-d1c3-4aae-80db-b0ebac5b0eb2 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
9422024-09-03T23:51:41.918ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 8765 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 36436d34-d1c3-4aae-80db-b0ebac5b0eb2 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
9432024-09-03T23:51:41.997ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9442024-09-03T23:51:41.998ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9452024-09-03T23:51:41.999ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9462024-09-03T23:51:42.000ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9472024-09-03T23:51:42.001ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9482024-09-03T23:51:42.003ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 1d4636f4-828e-412a-8daf-3bda355c92df, lookup_type: ById(1d4636f4-828e-412a-8daf-3bda355c92df) } result = Ok(())
9492024-09-03T23:51:42.003ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 1d4636f4-828e-412a-8daf-3bda355c92df, time_created: 2024-09-03T23:51:39.139957Z, time_modified: 2024-09-03T23:51:39.139957Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:765
9502024-09-03T23:51:42.937ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = e286a3b0-940c-4952-a203-928167990d1b roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
9512024-09-03T23:51:42.937ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = e286a3b0-940c-4952-a203-928167990d1b resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
9522024-09-03T23:51:42.946ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 9153 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = e286a3b0-940c-4952-a203-928167990d1b response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
9532024-09-03T23:51:43.965ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = c419cd04-6f3a-420c-aa6a-0591836e6516 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
9542024-09-03T23:51:43.965ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = c419cd04-6f3a-420c-aa6a-0591836e6516 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
9552024-09-03T23:51:43.967ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2331 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = c419cd04-6f3a-420c-aa6a-0591836e6516 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
9562024-09-03T23:51:44.004ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9572024-09-03T23:51:44.005ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9582024-09-03T23:51:44.006ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9592024-09-03T23:51:44.007ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9602024-09-03T23:51:44.008ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9612024-09-03T23:51:44.011ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 1d4636f4-828e-412a-8daf-3bda355c92df, lookup_type: ById(1d4636f4-828e-412a-8daf-3bda355c92df) } result = Ok(())
9622024-09-03T23:51:44.011ZINFOnexus: Rack initialized file = nexus/src/app/rack.rs:762
9632024-09-03T23:51:44.011ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
9642024-09-03T23:51:44.011ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
9652024-09-03T23:51:44.014ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
9662024-09-03T23:51:44.014ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
9672024-09-03T23:51:44.016ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
9682024-09-03T23:51:44.016ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
9692024-09-03T23:51:44.017ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
9702024-09-03T23:51:44.018ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
9712024-09-03T23:51:44.019ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
9722024-09-03T23:51:44.019ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
9732024-09-03T23:51:44.020ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
9742024-09-03T23:51:44.021ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
9752024-09-03T23:51:44.022ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9762024-09-03T23:51:44.024ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
9772024-09-03T23:51:44.024ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
9782024-09-03T23:51:44.025ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
9792024-09-03T23:51:44.026ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
9802024-09-03T23:51:44.026ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
9812024-09-03T23:51:44.027ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
9822024-09-03T23:51:44.027ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
9832024-09-03T23:51:44.028ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9842024-09-03T23:51:44.031ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
9852024-09-03T23:51:44.031ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
9862024-09-03T23:51:44.031ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
9872024-09-03T23:51:44.033ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
9882024-09-03T23:51:44.034ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
9892024-09-03T23:51:44.035ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
9902024-09-03T23:51:44.035ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
9912024-09-03T23:51:44.036ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
9922024-09-03T23:51:44.036ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
9932024-09-03T23:51:44.037ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
9942024-09-03T23:51:44.037ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
9952024-09-03T23:51:44.039ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
9962024-09-03T23:51:44.039ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
9972024-09-03T23:51:44.040ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
9982024-09-03T23:51:44.040ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
9992024-09-03T23:51:44.041ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10002024-09-03T23:51:44.044ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
10012024-09-03T23:51:44.044ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10022024-09-03T23:51:44.044ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10032024-09-03T23:51:44.045ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10042024-09-03T23:51:44.045ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10052024-09-03T23:51:44.046ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10062024-09-03T23:51:44.046ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10072024-09-03T23:51:44.049ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10082024-09-03T23:51:44.049ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10092024-09-03T23:51:44.051ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10102024-09-03T23:51:44.051ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10112024-09-03T23:51:44.052ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10122024-09-03T23:51:44.052ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10132024-09-03T23:51:44.053ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10142024-09-03T23:51:44.053ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10152024-09-03T23:51:44.054ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10162024-09-03T23:51:44.057ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
10172024-09-03T23:51:44.057ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10182024-09-03T23:51:44.057ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10192024-09-03T23:51:44.059ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10202024-09-03T23:51:44.059ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10212024-09-03T23:51:44.060ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10222024-09-03T23:51:44.060ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10232024-09-03T23:51:44.061ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10242024-09-03T23:51:44.064ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
10252024-09-03T23:51:44.064ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10262024-09-03T23:51:44.064ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10272024-09-03T23:51:44.069ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10282024-09-03T23:51:44.069ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10292024-09-03T23:51:44.070ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10302024-09-03T23:51:44.070ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10312024-09-03T23:51:44.071ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10322024-09-03T23:51:44.071ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10332024-09-03T23:51:44.073ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10342024-09-03T23:51:44.073ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10352024-09-03T23:51:44.074ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10362024-09-03T23:51:44.074ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10372024-09-03T23:51:44.076ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10382024-09-03T23:51:44.076ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10392024-09-03T23:51:44.077ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10402024-09-03T23:51:44.077ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10412024-09-03T23:51:44.078ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10422024-09-03T23:51:44.081ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
10432024-09-03T23:51:44.081ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10442024-09-03T23:51:44.081ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10452024-09-03T23:51:44.082ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10462024-09-03T23:51:44.082ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10472024-09-03T23:51:44.083ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10482024-09-03T23:51:44.084ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10492024-09-03T23:51:44.085ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10502024-09-03T23:51:44.087ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
10512024-09-03T23:51:44.087ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10522024-09-03T23:51:44.088ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10532024-09-03T23:51:44.092ZDEBGnexus (InternalApi): resolved names for firewall rules instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 2976bd07-76bd-4399-870b-d0394e02e2a3, kind: Service { id: 5a19fea2-ef2a-4710-a2dc-f909b9134850 }, name: Name("nexus-5a19fea2-ef2a-4710-a2dc-f909b9134850"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 232, 221])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 4c70480a-1678-45e9-b6dd-7c33aaf09ba7, kind: Service { id: 5f5ce676-2064-4d97-b873-fbcbc29495de }, name: Name("nexus-5f5ce676-2064-4d97-b873-fbcbc29495de"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 145, 61])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: eca333f3-d503-438d-96c9-fdd58cc22e48, kind: Service { id: 6a103559-9ed4-4654-9b5e-18577b1b0579 }, name: Name("nexus-6a103559-9ed4-4654-9b5e-18577b1b0579"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 187])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: 07996add-44ce-4253-be85-4745eb2604d5, kind: Service { id: 90a0c753-ce30-4bd3-a374-17c504cb8aee }, name: Name("external-dns-90a0c753-ce30-4bd3-a374-17c504cb8aee"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 251, 48])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 716ed353-46fc-4036-8260-0f0a30a9b8c2, kind: Service { id: 1f2af9fb-1e02-483c-afd2-2b8742b46afd }, name: Name("external-dns-1f2af9fb-1e02-483c-afd2-2b8742b46afd"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 138, 121])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
10542024-09-03T23:51:44.093ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10552024-09-03T23:51:44.093ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10562024-09-03T23:51:44.094ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10572024-09-03T23:51:44.095ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Fleet result = Ok(())
10582024-09-03T23:51:44.095ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10592024-09-03T23:51:44.095ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10602024-09-03T23:51:44.097ZDEBGnexus (InternalApi): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified.
10612024-09-03T23:51:44.100ZDEBGnexus (InternalApi): resolved firewall rules for sled agents sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 07996add-44ce-4253-be85-4745eb2604d5, kind: Service { id: 90a0c753-ce30-4bd3-a374-17c504cb8aee }, name: Name("external-dns-90a0c753-ce30-4bd3-a374-17c504cb8aee"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 251, 48])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 716ed353-46fc-4036-8260-0f0a30a9b8c2, kind: Service { id: 1f2af9fb-1e02-483c-afd2-2b8742b46afd }, name: Name("external-dns-1f2af9fb-1e02-483c-afd2-2b8742b46afd"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 138, 121])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 2976bd07-76bd-4399-870b-d0394e02e2a3, kind: Service { id: 5a19fea2-ef2a-4710-a2dc-f909b9134850 }, name: Name("nexus-5a19fea2-ef2a-4710-a2dc-f909b9134850"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 232, 221])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 4c70480a-1678-45e9-b6dd-7c33aaf09ba7, kind: Service { id: 5f5ce676-2064-4d97-b873-fbcbc29495de }, name: Name("nexus-5f5ce676-2064-4d97-b873-fbcbc29495de"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 145, 61])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: eca333f3-d503-438d-96c9-fdd58cc22e48, kind: Service { id: 6a103559-9ed4-4654-9b5e-18577b1b0579 }, name: Name("nexus-6a103559-9ed4-4654-9b5e-18577b1b0579"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 187])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
10622024-09-03T23:51:44.100ZDEBGnexus (InternalApi): resolved 2 rules for sleds
10632024-09-03T23:51:44.154ZDEBGnexus (InternalApi): resolved sleds for vpc oxide-services vpc_to_sled = [Sled { identity: SledIdentity { id: b281022b-35b2-452e-ad2b-78e12f6ca16a, time_created: 2024-09-03T23:51:41.530889Z, time_modified: 2024-09-03T23:51:41.530889Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 1d4636f4-828e-412a-8daf-3bda355c92df, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
10642024-09-03T23:51:44.155ZDEBGnexus (InternalApi): sending firewall rules to sled agents
10652024-09-03T23:51:44.155ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10662024-09-03T23:51:44.155ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10672024-09-03T23:51:44.156ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10682024-09-03T23:51:44.156ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10692024-09-03T23:51:44.158ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10702024-09-03T23:51:44.160ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Sled { parent: Fleet, key: b281022b-35b2-452e-ad2b-78e12f6ca16a, lookup_type: ById(b281022b-35b2-452e-ad2b-78e12f6ca16a) } result = Ok(())
10712024-09-03T23:51:44.190ZDEBGnexus (InternalApi): client request SledAgent = b281022b-35b2-452e-ad2b-78e12f6ca16a body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
10722024-09-03T23:51:44.192ZDEBGnexus (InternalApi): client response SledAgent = b281022b-35b2-452e-ad2b-78e12f6ca16a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", query: None, fragment: None }, status: 204, headers: {"x-request-id": "659bb9e7-b79a-414d-9ab9-3b57c9ff0f41", "date": "Tue, 03 Sep 2024 23:51:44 GMT"} })
10732024-09-03T23:51:44.192ZINFOnexus (InternalApi): updated firewall rules on 1 sleds file = nexus/networking/src/firewall_rules.rs:496
10742024-09-03T23:51:44.192ZINFOnexus: plumbed initial IP allowlist file = nexus/src/app/allow_list.rs:161
10752024-09-03T23:51:44.985ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = b2dc87fb-bdeb-4a70-8f9f-d9a4b65d898a roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
10762024-09-03T23:51:44.986ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = b2dc87fb-bdeb-4a70-8f9f-d9a4b65d898a resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
10772024-09-03T23:51:44.995ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 9369 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = b2dc87fb-bdeb-4a70-8f9f-d9a4b65d898a response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
10782024-09-03T23:51:46.013ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 8ce69ee1-941a-4426-91e9-4bbdf27b2504 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
10792024-09-03T23:51:46.014ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 8ce69ee1-941a-4426-91e9-4bbdf27b2504 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
10802024-09-03T23:51:46.016ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2892 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 8ce69ee1-941a-4426-91e9-4bbdf27b2504 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
10812024-09-03T23:51:47.036ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 75e8a13f-aeba-494a-8824-668aa4235fa6 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
10822024-09-03T23:51:47.036ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 75e8a13f-aeba-494a-8824-668aa4235fa6 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
10832024-09-03T23:51:47.038ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2158 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 75e8a13f-aeba-494a-8824-668aa4235fa6 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
10842024-09-03T23:51:48.058ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = f757ebc1-1dfb-4d2b-ae19-630ea423f5da roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
10852024-09-03T23:51:48.059ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = f757ebc1-1dfb-4d2b-ae19-630ea423f5da resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
10862024-09-03T23:51:48.060ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1657 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = f757ebc1-1dfb-4d2b-ae19-630ea423f5da response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
10872024-09-03T23:51:49.081ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 7b501e14-fe31-47e2-84dd-8b5223c6f8cd roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
10882024-09-03T23:51:49.081ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 7b501e14-fe31-47e2-84dd-8b5223c6f8cd resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
10892024-09-03T23:51:49.082ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1900 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 7b501e14-fe31-47e2-84dd-8b5223c6f8cd response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
10902024-09-03T23:51:49.244ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 2 reason = Timeout
10912024-09-03T23:51:49.244ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10922024-09-03T23:51:49.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10932024-09-03T23:51:49.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10942024-09-03T23:51:49.248ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
10952024-09-03T23:51:49.248ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10962024-09-03T23:51:49.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10972024-09-03T23:51:49.249ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 2 reason = Timeout
10982024-09-03T23:51:49.249ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10992024-09-03T23:51:49.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
11002024-09-03T23:51:49.250ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11012024-09-03T23:51:49.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11022024-09-03T23:51:49.251ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11032024-09-03T23:51:49.254ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b1196b3e-aa3c-4486-a0ad-52f372819a8f, lookup_type: ById(b1196b3e-aa3c-4486-a0ad-52f372819a8f) } result = Ok(())
11042024-09-03T23:51:49.254ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11052024-09-03T23:51:49.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11062024-09-03T23:51:49.265ZINFOnexus (BackgroundTasks): found new target blueprint (first find) background_task = blueprint_loader file = nexus/src/app/background/tasks/blueprint_load.rs:88 target_id = b1196b3e-aa3c-4486-a0ad-52f372819a8f time_created = 2024-09-03 23:51:19.204380 UTC
11072024-09-03T23:51:49.265ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.441251ms iteration = 2 status = {"enabled":false,"status":"first target blueprint","target_id":"b1196b3e-aa3c-4486-a0ad-52f372819a8f","time_created":"2024-09-03T23:51:19.204380Z","time_found":"2024-09-03T23:51:49.265674949Z"}
11082024-09-03T23:51:49.265ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 2 reason = Dependency
11092024-09-03T23:51:49.265ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 2 reason = Dependency
11102024-09-03T23:51:49.265ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = b1196b3e-aa3c-4486-a0ad-52f372819a8f
11112024-09-03T23:51:49.265ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.98\u{b5}s iteration = 2 status = {"enabled":false,"target_id":"b1196b3e-aa3c-4486-a0ad-52f372819a8f"}
11122024-09-03T23:51:49.265ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11132024-09-03T23:51:49.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11142024-09-03T23:51:49.266ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11152024-09-03T23:51:49.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11162024-09-03T23:51:49.266ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11172024-09-03T23:51:49.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11182024-09-03T23:51:49.266ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11192024-09-03T23:51:49.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11202024-09-03T23:51:49.266ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11212024-09-03T23:51:49.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11222024-09-03T23:51:49.267ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11232024-09-03T23:51:49.269ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
11242024-09-03T23:51:49.269ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11252024-09-03T23:51:49.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11262024-09-03T23:51:49.269ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11272024-09-03T23:51:49.271ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
11282024-09-03T23:51:49.271ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11292024-09-03T23:51:49.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11302024-09-03T23:51:49.271ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11312024-09-03T23:51:49.273ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
11322024-09-03T23:51:49.273ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11332024-09-03T23:51:49.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11342024-09-03T23:51:49.273ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11352024-09-03T23:51:49.274ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
11362024-09-03T23:51:49.274ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11372024-09-03T23:51:49.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11382024-09-03T23:51:49.274ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11392024-09-03T23:51:49.276ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
11402024-09-03T23:51:49.276ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11412024-09-03T23:51:49.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11422024-09-03T23:51:49.283ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
11432024-09-03T23:51:49.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
11442024-09-03T23:51:49.308ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::4]:32222/node/id
11452024-09-03T23:51:49.314ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 64.49562ms iteration = 2 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
11462024-09-03T23:51:49.339ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::6]:32222/node/id
11472024-09-03T23:51:49.376ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::3]:32222/node/id
11482024-09-03T23:51:49.410ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::5]:32222/node/id
11492024-09-03T23:51:49.445ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::7]:32222/node/id
11502024-09-03T23:51:50.102ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 27de3856-617a-484e-93aa-c2cf9e1c3717 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
11512024-09-03T23:51:50.102ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 27de3856-617a-484e-93aa-c2cf9e1c3717 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
11522024-09-03T23:51:50.104ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2724 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 27de3856-617a-484e-93aa-c2cf9e1c3717 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
11532024-09-03T23:51:50.414ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::3)), port: Some(32222), path: "/node/id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "24345c8e-abb1-42a0-b5c2-04de7d8abbae", "content-length": "64", "date": "Tue, 03 Sep 2024 23:51:49 GMT"} })
11542024-09-03T23:51:50.414ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11552024-09-03T23:51:50.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11562024-09-03T23:51:50.416ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11572024-09-03T23:51:50.417ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
11582024-09-03T23:51:50.417ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11592024-09-03T23:51:50.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11602024-09-03T23:51:50.432ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::6)), port: Some(32222), path: "/node/id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "bee4653d-d33d-4feb-befb-d2b0730e27ad", "content-length": "64", "date": "Tue, 03 Sep 2024 23:51:50 GMT"} })
11612024-09-03T23:51:50.432ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11622024-09-03T23:51:50.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11632024-09-03T23:51:50.434ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11642024-09-03T23:51:50.435ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
11652024-09-03T23:51:50.435ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11662024-09-03T23:51:50.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11672024-09-03T23:51:50.463ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::7)), port: Some(32222), path: "/node/id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "df4453f6-3398-4d3e-96e5-434f23e58cfb", "content-length": "64", "date": "Tue, 03 Sep 2024 23:51:49 GMT"} })
11682024-09-03T23:51:50.463ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11692024-09-03T23:51:50.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11702024-09-03T23:51:50.465ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11712024-09-03T23:51:50.467ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
11722024-09-03T23:51:50.467ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11732024-09-03T23:51:50.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11742024-09-03T23:51:50.488ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::4)), port: Some(32222), path: "/node/id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "fb12b700-ba03-4055-8341-5d59e1ae503d", "content-length": "64", "date": "Tue, 03 Sep 2024 23:51:50 GMT"} })
11752024-09-03T23:51:50.488ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11762024-09-03T23:51:50.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11772024-09-03T23:51:50.490ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11782024-09-03T23:51:50.492ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
11792024-09-03T23:51:50.492ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11802024-09-03T23:51:50.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11812024-09-03T23:51:50.524ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::5)), port: Some(32222), path: "/node/id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "0bbd2399-c4ed-49ec-bae2-edfb0d4d08ca", "content-length": "64", "date": "Tue, 03 Sep 2024 23:51:49 GMT"} })
11822024-09-03T23:51:50.525ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11832024-09-03T23:51:50.525ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11842024-09-03T23:51:50.526ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11852024-09-03T23:51:50.528ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
11862024-09-03T23:51:50.528ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11872024-09-03T23:51:50.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11882024-09-03T23:51:50.538ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 1.272616815s iteration = 2 status = {"nsuccess":5}
11892024-09-03T23:51:51.123ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 906ad00b-5f3a-40d3-9132-73acc1d948df roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
11902024-09-03T23:51:51.123ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 906ad00b-5f3a-40d3-9132-73acc1d948df resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
11912024-09-03T23:51:51.125ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2500 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 906ad00b-5f3a-40d3-9132-73acc1d948df response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
11922024-09-03T23:51:51.293ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50060 req_id = 703e49e5-a4f1-444e-a682-0686165b7d45 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
11932024-09-03T23:51:51.293ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50060 req_id = 703e49e5-a4f1-444e-a682-0686165b7d45 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
11942024-09-03T23:51:51.296ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3295 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50060 req_id = 703e49e5-a4f1-444e-a682-0686165b7d45 response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
11952024-09-03T23:51:52.145ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 976c989c-1fd3-4ca3-a8bd-ce068d051140 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
11962024-09-03T23:51:52.145ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 976c989c-1fd3-4ca3-a8bd-ce068d051140 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
11972024-09-03T23:51:52.147ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2193 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 976c989c-1fd3-4ca3-a8bd-ce068d051140 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
11982024-09-03T23:51:53.165ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = d16a8996-ef1c-475c-8d96-fe70dccbad1a roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
11992024-09-03T23:51:53.166ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = d16a8996-ef1c-475c-8d96-fe70dccbad1a resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
12002024-09-03T23:51:53.167ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1983 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = d16a8996-ef1c-475c-8d96-fe70dccbad1a response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
12012024-09-03T23:51:54.185ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 002592ae-5a56-43a2-adfd-9cdbc7c642f5 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
12022024-09-03T23:51:54.185ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 002592ae-5a56-43a2-adfd-9cdbc7c642f5 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
12032024-09-03T23:51:54.187ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2502 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 002592ae-5a56-43a2-adfd-9cdbc7c642f5 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
12042024-09-03T23:51:55.206ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = d3b3177a-754d-4569-b780-5396da43bffb roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
12052024-09-03T23:51:55.206ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = d3b3177a-754d-4569-b780-5396da43bffb resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
12062024-09-03T23:51:55.207ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1772 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = d3b3177a-754d-4569-b780-5396da43bffb response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
12072024-09-03T23:51:56.226ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 8a99eb10-7ca7-45df-879a-88c48ec0048f roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
12082024-09-03T23:51:56.226ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 8a99eb10-7ca7-45df-879a-88c48ec0048f resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
12092024-09-03T23:51:56.229ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3273 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 8a99eb10-7ca7-45df-879a-88c48ec0048f response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
12102024-09-03T23:51:57.248ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = e4de1d47-0923-491b-8b13-d26fd37ed99f roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
12112024-09-03T23:51:57.248ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = e4de1d47-0923-491b-8b13-d26fd37ed99f resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
12122024-09-03T23:51:57.250ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2073 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = e4de1d47-0923-491b-8b13-d26fd37ed99f response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
12132024-09-03T23:51:58.270ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = dce6f6a6-a2cc-416b-a67f-ac15f8a438d5 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
12142024-09-03T23:51:58.271ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = dce6f6a6-a2cc-416b-a67f-ac15f8a438d5 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
12152024-09-03T23:51:58.272ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2397 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = dce6f6a6-a2cc-416b-a67f-ac15f8a438d5 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
12162024-09-03T23:51:59.244ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 3 reason = Timeout
12172024-09-03T23:51:59.244ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12182024-09-03T23:51:59.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12192024-09-03T23:51:59.246ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12202024-09-03T23:51:59.248ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
12212024-09-03T23:51:59.248ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12222024-09-03T23:51:59.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12232024-09-03T23:51:59.250ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 3 reason = Timeout
12242024-09-03T23:51:59.250ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12252024-09-03T23:51:59.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12262024-09-03T23:51:59.250ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12272024-09-03T23:51:59.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12282024-09-03T23:51:59.252ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12292024-09-03T23:51:59.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12302024-09-03T23:51:59.252ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12312024-09-03T23:51:59.253ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.324142ms iteration = 3 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
12322024-09-03T23:51:59.255ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b1196b3e-aa3c-4486-a0ad-52f372819a8f, lookup_type: ById(b1196b3e-aa3c-4486-a0ad-52f372819a8f) } result = Ok(())
12332024-09-03T23:51:59.255ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12342024-09-03T23:51:59.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12352024-09-03T23:51:59.292ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 21996955-bd9e-45e7-bbc5-acc459ad6107 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
12362024-09-03T23:51:59.292ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 21996955-bd9e-45e7-bbc5-acc459ad6107 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
12372024-09-03T23:51:59.295ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2655 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 21996955-bd9e-45e7-bbc5-acc459ad6107 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
12382024-09-03T23:51:59.353ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b1196b3e-aa3c-4486-a0ad-52f372819a8f original_time_created = 2024-09-03 23:51:19.204380 UTC target_id = b1196b3e-aa3c-4486-a0ad-52f372819a8f time_created = 2024-09-03 23:51:19.204380 UTC
12392024-09-03T23:51:59.353ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 108.970047ms iteration = 3 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b1196b3e-aa3c-4486-a0ad-52f372819a8f","time_created":"2024-09-03T23:51:19.204380Z"}
12402024-09-03T23:52:00.313ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 4a05d83b-af40-436f-85c8-7b0283811bce roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
12412024-09-03T23:52:00.313ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 4a05d83b-af40-436f-85c8-7b0283811bce resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
12422024-09-03T23:52:00.315ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2024 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 4a05d83b-af40-436f-85c8-7b0283811bce response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
12432024-09-03T23:52:01.334ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 5eceb998-186f-4503-ac29-7e184d053ed9 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
12442024-09-03T23:52:01.335ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 5eceb998-186f-4503-ac29-7e184d053ed9 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
12452024-09-03T23:52:01.337ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2562 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 5eceb998-186f-4503-ac29-7e184d053ed9 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
12462024-09-03T23:52:02.356ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 85098d84-29a9-4aaf-993b-104e45174455 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
12472024-09-03T23:52:02.357ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 85098d84-29a9-4aaf-993b-104e45174455 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
12482024-09-03T23:52:02.358ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2167 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 85098d84-29a9-4aaf-993b-104e45174455 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
12492024-09-03T23:52:03.378ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = f8669f4e-a162-4ad8-978f-3e8c4cea1993 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
12502024-09-03T23:52:03.378ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = f8669f4e-a162-4ad8-978f-3e8c4cea1993 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
12512024-09-03T23:52:03.380ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2887 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = f8669f4e-a162-4ad8-978f-3e8c4cea1993 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
12522024-09-03T23:52:04.398ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 79323ff4-54e3-48a1-988a-22b11e2d7569 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
12532024-09-03T23:52:04.399ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 79323ff4-54e3-48a1-988a-22b11e2d7569 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
12542024-09-03T23:52:04.400ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1988 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 79323ff4-54e3-48a1-988a-22b11e2d7569 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
12552024-09-03T23:52:05.421ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = b4f54820-6452-412a-9757-33cda2bcd4d9 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
12562024-09-03T23:52:05.422ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = b4f54820-6452-412a-9757-33cda2bcd4d9 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
12572024-09-03T23:52:05.423ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2764 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = b4f54820-6452-412a-9757-33cda2bcd4d9 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
12582024-09-03T23:52:06.443ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = e16d4b61-d720-42b5-b03a-b7c49b8ed973 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
12592024-09-03T23:52:06.443ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = e16d4b61-d720-42b5-b03a-b7c49b8ed973 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
12602024-09-03T23:52:06.445ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1969 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = e16d4b61-d720-42b5-b03a-b7c49b8ed973 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
12612024-09-03T23:52:07.463ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 98c487a4-bca6-400a-8b32-bf898484de8f roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
12622024-09-03T23:52:07.464ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 98c487a4-bca6-400a-8b32-bf898484de8f resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
12632024-09-03T23:52:07.465ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1504 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 98c487a4-bca6-400a-8b32-bf898484de8f response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
12642024-09-03T23:52:08.484ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 1d918119-dbd8-4075-9d6d-99fc1c145666 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
12652024-09-03T23:52:08.484ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 1d918119-dbd8-4075-9d6d-99fc1c145666 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
12662024-09-03T23:52:08.486ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2314 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 1d918119-dbd8-4075-9d6d-99fc1c145666 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
12672024-09-03T23:52:09.243ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 2 reason = Timeout
12682024-09-03T23:52:09.244ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 4 reason = Timeout
12692024-09-03T23:52:09.244ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 2 reason = Timeout
12702024-09-03T23:52:09.244ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 2 reason = Timeout
12712024-09-03T23:52:09.244ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
12722024-09-03T23:52:09.244ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
12732024-09-03T23:52:09.244ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12742024-09-03T23:52:09.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
12752024-09-03T23:52:09.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
12762024-09-03T23:52:09.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12772024-09-03T23:52:09.246ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 2 reason = Timeout
12782024-09-03T23:52:09.246ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 4 reason = Timeout
12792024-09-03T23:52:09.246ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
12802024-09-03T23:52:09.246ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 2 reason = Timeout
12812024-09-03T23:52:09.246ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
12822024-09-03T23:52:09.246ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 2 reason = Timeout
12832024-09-03T23:52:09.246ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12842024-09-03T23:52:09.246ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 2 reason = Timeout
12852024-09-03T23:52:09.246ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
12862024-09-03T23:52:09.246ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
12872024-09-03T23:52:09.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12882024-09-03T23:52:09.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
12892024-09-03T23:52:09.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
12902024-09-03T23:52:09.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
12912024-09-03T23:52:09.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
12922024-09-03T23:52:09.246ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b281022b-35b2-452e-ad2b-78e12f6ca16a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b281022b-35b2-452e-ad2b-78e12f6ca16a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1107, tv_nsec: 748982994 } })
12932024-09-03T23:52:09.247ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
12942024-09-03T23:52:09.247ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.399833ms iteration = 2 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
12952024-09-03T23:52:09.247ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12962024-09-03T23:52:09.248ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12972024-09-03T23:52:09.248ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12982024-09-03T23:52:09.249ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 2 reason = Timeout
12992024-09-03T23:52:09.249ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
13002024-09-03T23:52:09.249ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 2 reason = Timeout
13012024-09-03T23:52:09.249ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
13022024-09-03T23:52:09.249ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
13032024-09-03T23:52:09.249ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 2 reason = Timeout
13042024-09-03T23:52:09.249ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13052024-09-03T23:52:09.249ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 4 reason = Timeout
13062024-09-03T23:52:09.249ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13072024-09-03T23:52:09.249ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 2 reason = Timeout
13082024-09-03T23:52:09.249ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 2 reason = Timeout
13092024-09-03T23:52:09.249ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
13102024-09-03T23:52:09.249ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 2 reason = Timeout
13112024-09-03T23:52:09.249ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
13122024-09-03T23:52:09.249ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
13132024-09-03T23:52:09.249ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 2 reason = Timeout
13142024-09-03T23:52:09.249ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
13152024-09-03T23:52:09.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
13162024-09-03T23:52:09.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
13172024-09-03T23:52:09.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13182024-09-03T23:52:09.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
13192024-09-03T23:52:09.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
13202024-09-03T23:52:09.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13212024-09-03T23:52:09.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
13222024-09-03T23:52:09.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
13232024-09-03T23:52:09.250ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
13242024-09-03T23:52:09.251ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13252024-09-03T23:52:09.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13262024-09-03T23:52:09.251ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13272024-09-03T23:52:09.251ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
13282024-09-03T23:52:09.251ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13292024-09-03T23:52:09.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13302024-09-03T23:52:09.252ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
13312024-09-03T23:52:09.252ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13322024-09-03T23:52:09.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
13332024-09-03T23:52:09.254ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
13342024-09-03T23:52:09.254ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
13352024-09-03T23:52:09.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
13362024-09-03T23:52:09.256ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13372024-09-03T23:52:09.258ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
13382024-09-03T23:52:09.258ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13392024-09-03T23:52:09.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13402024-09-03T23:52:09.258ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13412024-09-03T23:52:09.259ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13422024-09-03T23:52:09.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13432024-09-03T23:52:09.260ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
13442024-09-03T23:52:09.260ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
13452024-09-03T23:52:09.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
13462024-09-03T23:52:09.262ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13472024-09-03T23:52:09.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13482024-09-03T23:52:09.264ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b281022b-35b2-452e-ad2b-78e12f6ca16a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b281022b-35b2-452e-ad2b-78e12f6ca16a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1107, tv_nsec: 766234656 } })
13492024-09-03T23:52:09.264ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13502024-09-03T23:52:09.264ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
13512024-09-03T23:52:09.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
13522024-09-03T23:52:09.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
13532024-09-03T23:52:09.264ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13542024-09-03T23:52:09.265ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df
13552024-09-03T23:52:09.267ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
13562024-09-03T23:52:09.267ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13572024-09-03T23:52:09.267ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13582024-09-03T23:52:09.276ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13592024-09-03T23:52:09.278ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
13602024-09-03T23:52:09.278ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
13612024-09-03T23:52:09.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
13622024-09-03T23:52:09.281ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13632024-09-03T23:52:09.285ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b1196b3e-aa3c-4486-a0ad-52f372819a8f, lookup_type: ById(b1196b3e-aa3c-4486-a0ad-52f372819a8f) } result = Ok(())
13642024-09-03T23:52:09.285ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13652024-09-03T23:52:09.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13662024-09-03T23:52:09.297ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
13672024-09-03T23:52:09.297ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
13682024-09-03T23:52:09.297ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
13692024-09-03T23:52:09.297ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a3aa294d-db1f-44aa-9478-a5329534feaa", "content-length": "26", "date": "Tue, 03 Sep 2024 23:52:09 GMT"} })
13702024-09-03T23:52:09.297ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
13712024-09-03T23:52:09.297ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b1196b3e-aa3c-4486-a0ad-52f372819a8f original_time_created = 2024-09-03 23:51:19.204380 UTC target_id = b1196b3e-aa3c-4486-a0ad-52f372819a8f time_created = 2024-09-03 23:51:19.204380 UTC
13722024-09-03T23:52:09.297ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 53.475292ms iteration = 4 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b1196b3e-aa3c-4486-a0ad-52f372819a8f","time_created":"2024-09-03T23:51:19.204380Z"}
13732024-09-03T23:52:09.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
13742024-09-03T23:52:09.298ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
13752024-09-03T23:52:09.300ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:56
13762024-09-03T23:52:09.300ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
13772024-09-03T23:52:09.300ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
13782024-09-03T23:52:09.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
13792024-09-03T23:52:09.303ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
13802024-09-03T23:52:09.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
13812024-09-03T23:52:09.314ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 64.930158ms iteration = 4 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
13822024-09-03T23:52:09.314ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 64.974049ms iteration = 2 status = {"errors":[],"garbage_collect_requested":[]}
13832024-09-03T23:52:09.314ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
13842024-09-03T23:52:09.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
13852024-09-03T23:52:09.318ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b281022b-35b2-452e-ad2b-78e12f6ca16a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b281022b-35b2-452e-ad2b-78e12f6ca16a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1107, tv_nsec: 820256659 } })
13862024-09-03T23:52:09.319ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
13872024-09-03T23:52:09.326ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13882024-09-03T23:52:09.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
13892024-09-03T23:52:09.344ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 98.88067ms iteration = 2 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
13902024-09-03T23:52:09.345ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13912024-09-03T23:52:09.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
13922024-09-03T23:52:09.348ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13932024-09-03T23:52:09.350ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: b281022b-35b2-452e-ad2b-78e12f6ca16a, lookup_type: ById(b281022b-35b2-452e-ad2b-78e12f6ca16a) } result = Ok(())
13942024-09-03T23:52:09.350ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13952024-09-03T23:52:09.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
13962024-09-03T23:52:09.354ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13972024-09-03T23:52:09.354ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df zone_address = fd00:1122:3344:101::2
13982024-09-03T23:52:09.354ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
13992024-09-03T23:52:09.354ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:56
14002024-09-03T23:52:09.354ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
14012024-09-03T23:52:09.354ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
14022024-09-03T23:52:09.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14032024-09-03T23:52:09.355ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "96446a77-ff7e-45ab-84cb-95a30fcffd76", "content-length": "26", "date": "Tue, 03 Sep 2024 23:52:09 GMT"} })
14042024-09-03T23:52:09.355ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
14052024-09-03T23:52:09.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
14062024-09-03T23:52:09.356ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df
14072024-09-03T23:52:09.359ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 109.753254ms iteration = 2 status = {"errors":[],"records_set_to_done":[]}
14082024-09-03T23:52:09.364ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14092024-09-03T23:52:09.364ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14102024-09-03T23:52:09.365ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 115.571759ms iteration = 2 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
14112024-09-03T23:52:09.366ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14122024-09-03T23:52:09.367ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14132024-09-03T23:52:09.372ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 128.642711ms iteration = 2 status = {}
14142024-09-03T23:52:09.379ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14152024-09-03T23:52:09.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
14162024-09-03T23:52:09.381ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14172024-09-03T23:52:09.382ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14182024-09-03T23:52:09.386ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14192024-09-03T23:52:09.386ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14202024-09-03T23:52:09.391ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
14212024-09-03T23:52:09.391ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
14222024-09-03T23:52:09.391ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "dc3d7ce0-cd1f-4685-b928-75477174c1a9", "content-length": "26", "date": "Tue, 03 Sep 2024 23:52:09 GMT"} })
14232024-09-03T23:52:09.391ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
14242024-09-03T23:52:09.392ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
14252024-09-03T23:52:09.395ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14262024-09-03T23:52:09.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14272024-09-03T23:52:09.402ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:480 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
14282024-09-03T23:52:09.402ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 152.467613ms iteration = 2 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
14292024-09-03T23:52:09.420ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14302024-09-03T23:52:09.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
14312024-09-03T23:52:09.422ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14322024-09-03T23:52:09.424ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
14332024-09-03T23:52:09.424ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14342024-09-03T23:52:09.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
14352024-09-03T23:52:09.426ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14362024-09-03T23:52:09.427ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
14372024-09-03T23:52:09.427ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14382024-09-03T23:52:09.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
14392024-09-03T23:52:09.428ZDEBGnexus (BackgroundTasks): client request SledAgent = b281022b-35b2-452e-ad2b-78e12f6ca16a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
14402024-09-03T23:52:09.429ZDEBGnexus (BackgroundTasks): client response SledAgent = b281022b-35b2-452e-ad2b-78e12f6ca16a background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "fdb5dafb-ae29-4fcd-a101-7d02c9aed00a", "content-length": "372", "date": "Tue, 03 Sep 2024 23:52:09 GMT"} })
14412024-09-03T23:52:09.429ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14422024-09-03T23:52:09.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14432024-09-03T23:52:09.432ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14442024-09-03T23:52:09.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14452024-09-03T23:52:09.437ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14462024-09-03T23:52:09.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14472024-09-03T23:52:09.441ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 195.515511ms iteration = 4 status = {"physical_disks_added":0}
14482024-09-03T23:52:09.445ZDEBGnexus (BackgroundTasks): client request SledAgent = b281022b-35b2-452e-ad2b-78e12f6ca16a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
14492024-09-03T23:52:09.446ZDEBGnexus (BackgroundTasks): client response SledAgent = b281022b-35b2-452e-ad2b-78e12f6ca16a background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "288cfa93-8f78-4daa-ab66-b40bf08ca6c7", "date": "Tue, 03 Sep 2024 23:52:09 GMT"} })
14502024-09-03T23:52:09.447ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 197.434441ms iteration = 2 status = {}
14512024-09-03T23:52:09.453ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
14522024-09-03T23:52:09.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
14532024-09-03T23:52:09.471ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
14542024-09-03T23:52:09.471ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "863c46a0-6e16-4640-9aad-9533356d3703", "content-length": "1", "date": "Tue, 03 Sep 2024 23:52:09 GMT"} })
14552024-09-03T23:52:09.472ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
14562024-09-03T23:52:09.473ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
14572024-09-03T23:52:09.483ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b281022b-35b2-452e-ad2b-78e12f6ca16a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b281022b-35b2-452e-ad2b-78e12f6ca16a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1107, tv_nsec: 985737073 } })
14582024-09-03T23:52:09.484ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = service_zone_nat_tracker file = nexus/src/app/mod.rs:1050
14592024-09-03T23:52:09.496ZDEBGnexus (BackgroundTasks): client request SledAgent = b281022b-35b2-452e-ad2b-78e12f6ca16a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
14602024-09-03T23:52:09.497ZDEBGnexus (BackgroundTasks): client response SledAgent = b281022b-35b2-452e-ad2b-78e12f6ca16a background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "4c39b7ea-02b1-4fd5-8680-7948b2d130da", "content-length": "691", "date": "Tue, 03 Sep 2024 23:52:09 GMT"} })
14612024-09-03T23:52:09.499ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
14622024-09-03T23:52:09.499ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
14632024-09-03T23:52:09.499ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
14642024-09-03T23:52:09.500ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 254.328647ms iteration = 2 status = {}
14652024-09-03T23:52:09.500ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 256.980314ms iteration = 2 status = null
14662024-09-03T23:52:09.505ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 2964bba7-e933-4ee5-96a0-c8af002bccf4 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
14672024-09-03T23:52:09.505ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 2964bba7-e933-4ee5-96a0-c8af002bccf4 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
14682024-09-03T23:52:09.507ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1744 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 2964bba7-e933-4ee5-96a0-c8af002bccf4 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
14692024-09-03T23:52:09.538ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 288.496112ms iteration = 2 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
14702024-09-03T23:52:09.539ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:56
14712024-09-03T23:52:09.539ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:241 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
14722024-09-03T23:52:09.539ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 289.392583ms iteration = 2 status = {"destroyed_active_vmms":0,"error":null,"failed_active_vmms":0,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
14732024-09-03T23:52:09.546ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = service_zone_nat_tracker file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
14742024-09-03T23:52:09.546ZDEBGnexus (MgsClient): client request background_task = service_zone_nat_tracker body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
14752024-09-03T23:52:09.546ZDEBGnexus (MgsClient): client response background_task = service_zone_nat_tracker result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d02ab0b7-c967-430a-b357-9d02663d14e6", "content-length": "26", "date": "Tue, 03 Sep 2024 23:52:09 GMT"} })
14762024-09-03T23:52:09.546ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = service_zone_nat_tracker file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
14772024-09-03T23:52:09.548ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = service_zone_nat_tracker file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
14782024-09-03T23:52:09.552ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14792024-09-03T23:52:09.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14802024-09-03T23:52:09.554ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: ec64e2ff-6fd0-4ab3-a8fa-a8a710b73297, rack_id: 1d4636f4-828e-412a-8daf-3bda355c92df, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(ccbb015a-58a4-4f0f-8a1a-5716d0b9db06) } rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df switch_location = Switch0
14812024-09-03T23:52:09.554ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14822024-09-03T23:52:09.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14832024-09-03T23:52:09.572ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
14842024-09-03T23:52:09.572ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "45cc3401-ee16-4adc-bca3-90df4cd7e96e", "content-length": "121", "date": "Tue, 03 Sep 2024 23:52:09 GMT"} })
14852024-09-03T23:52:09.574ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
14862024-09-03T23:52:09.574ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = ccbb015a-58a4-4f0f-8a1a-5716d0b9db06
14872024-09-03T23:52:09.577ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
14882024-09-03T23:52:09.577ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
14892024-09-03T23:52:09.577ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df routes = {}
14902024-09-03T23:52:09.577ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df routes = {}
14912024-09-03T23:52:09.577ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df
14922024-09-03T23:52:09.577ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14932024-09-03T23:52:09.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14942024-09-03T23:52:09.580ZDEBGnexus (DpdClient): client request background_task = service_zone_nat_tracker body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
14952024-09-03T23:52:09.580ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
14962024-09-03T23:52:09.581ZDEBGnexus (DpdClient): client response background_task = service_zone_nat_tracker result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/trigger", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "dd718b66-421b-4ad8-911e-86f764fa2657", "content-length": "4", "date": "Tue, 03 Sep 2024 23:52:09 GMT"} })
14972024-09-03T23:52:09.581ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "9227d128-ada3-4874-9777-8a4617cbb2b2", "content-length": "2", "date": "Tue, 03 Sep 2024 23:52:09 GMT"} })
14982024-09-03T23:52:09.581ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
14992024-09-03T23:52:09.581ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "784efad3-1863-4d14-bfe3-b0bbd309ddcb", "content-length": "52", "date": "Tue, 03 Sep 2024 23:52:09 GMT"} })
15002024-09-03T23:52:09.582ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 336.405274ms iteration = 2 status = 5
15012024-09-03T23:52:09.585ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df switch_location = Switch0
15022024-09-03T23:52:09.587ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
15032024-09-03T23:52:09.756ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "8a02861e-7892-4354-ade7-21c74da0a2e2", "date": "Tue, 03 Sep 2024 23:52:09 GMT"} })
15042024-09-03T23:52:09.756ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df switch = Switch0
15052024-09-03T23:52:09.756ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
15062024-09-03T23:52:09.756ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d8c43b33-7a2e-4ded-897d-592de19b3c34", "content-length": "524", "date": "Tue, 03 Sep 2024 23:52:09 GMT"} })
15072024-09-03T23:52:09.756ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15082024-09-03T23:52:09.756ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15092024-09-03T23:52:09.775ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15102024-09-03T23:52:09.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15112024-09-03T23:52:09.780ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15122024-09-03T23:52:09.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15132024-09-03T23:52:09.795ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15142024-09-03T23:52:09.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15152024-09-03T23:52:09.806ZWARNnexus (BackgroundTasks): no bootstore config found in db background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1212 key = network_key rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df
15162024-09-03T23:52:09.806ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15172024-09-03T23:52:09.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15182024-09-03T23:52:09.811ZINFOnexus (BackgroundTasks): updating bootstore config background_task = switch_port_config_manager config = EarlyNetworkConfig { body: EarlyNetworkConfigBody { ntp_servers: ["0.pool.ntp.org"], rack_network_config: Some(RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [PortConfigV2 { addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], autoneg: false, bgp_peers: [], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), local_pref: None, nexthop: 10.151.1.100, vlan_id: None }], switch: Switch0, uplink_port_fec: None, uplink_port_speed: Speed40G }], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 } }) }, generation: 3, schema_version: 2 } file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1269 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df
15192024-09-03T23:52:09.813ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = PUT rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
15202024-09-03T23:52:09.814ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "637be126-b885-4245-961e-006e3748878d", "date": "Tue, 03 Sep 2024 23:52:09 GMT"} })
15212024-09-03T23:52:09.816ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15222024-09-03T23:52:09.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15232024-09-03T23:52:09.827ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 581.796739ms iteration = 2 status = {}
15242024-09-03T23:52:10.316ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50060 req_id = 29a8ad62-5747-46af-a62e-f188e5ad9465 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
15252024-09-03T23:52:10.317ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50060 req_id = 29a8ad62-5747-46af-a62e-f188e5ad9465 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
15262024-09-03T23:52:10.321ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 4197 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50060 req_id = 29a8ad62-5747-46af-a62e-f188e5ad9465 response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
15272024-09-03T23:52:10.322ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50060 req_id = cfdcc681-6bf1-471f-b425-531d79c68b28 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
15282024-09-03T23:52:10.323ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50060 req_id = cfdcc681-6bf1-471f-b425-531d79c68b28 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
15292024-09-03T23:52:10.325ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2797 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50060 req_id = cfdcc681-6bf1-471f-b425-531d79c68b28 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
15302024-09-03T23:52:10.656ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = c98bb301-0ffb-4ab6-bd32-c8a0681eb4bd roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
15312024-09-03T23:52:10.656ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = c98bb301-0ffb-4ab6-bd32-c8a0681eb4bd resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
15322024-09-03T23:52:10.658ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2297 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = c98bb301-0ffb-4ab6-bd32-c8a0681eb4bd response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
15332024-09-03T23:52:11.676ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = f8e1478b-55e4-4c9e-892e-140cd1993aea roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
15342024-09-03T23:52:11.677ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = f8e1478b-55e4-4c9e-892e-140cd1993aea resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
15352024-09-03T23:52:11.679ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2188 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = f8e1478b-55e4-4c9e-892e-140cd1993aea response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
15362024-09-03T23:52:12.698ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = cedcc2f8-1d44-4714-b08a-d39afbd00e05 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
15372024-09-03T23:52:12.698ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = cedcc2f8-1d44-4714-b08a-d39afbd00e05 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
15382024-09-03T23:52:12.699ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1858 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = cedcc2f8-1d44-4714-b08a-d39afbd00e05 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
15392024-09-03T23:52:13.718ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 40677951-72bd-43e5-bd72-71f537d98dfd roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
15402024-09-03T23:52:13.718ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 40677951-72bd-43e5-bd72-71f537d98dfd resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
15412024-09-03T23:52:13.722ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3595 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 40677951-72bd-43e5-bd72-71f537d98dfd response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
15422024-09-03T23:52:14.742ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 8760ba1e-0893-46b6-97bf-5a41b1115822 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
15432024-09-03T23:52:14.742ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 8760ba1e-0893-46b6-97bf-5a41b1115822 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
15442024-09-03T23:52:14.744ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2051 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 8760ba1e-0893-46b6-97bf-5a41b1115822 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
15452024-09-03T23:52:15.763ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 3afb974b-827a-49f6-9b34-88ae8b8288c9 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
15462024-09-03T23:52:15.763ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 3afb974b-827a-49f6-9b34-88ae8b8288c9 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
15472024-09-03T23:52:15.765ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2165 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 3afb974b-827a-49f6-9b34-88ae8b8288c9 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
15482024-09-03T23:52:16.784ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 7828a17c-daa9-4552-8640-ecd86a5762af roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
15492024-09-03T23:52:16.784ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 7828a17c-daa9-4552-8640-ecd86a5762af resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
15502024-09-03T23:52:16.786ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1918 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 7828a17c-daa9-4552-8640-ecd86a5762af response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
15512024-09-03T23:52:17.804ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 9fe54e56-cced-43f6-87f1-b26a01561f1b roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
15522024-09-03T23:52:17.804ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 9fe54e56-cced-43f6-87f1-b26a01561f1b resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
15532024-09-03T23:52:17.806ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2101 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 9fe54e56-cced-43f6-87f1-b26a01561f1b response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
15542024-09-03T23:52:18.824ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 70e0029f-5d5f-4b9a-aa60-dcc41be73709 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
15552024-09-03T23:52:18.825ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 70e0029f-5d5f-4b9a-aa60-dcc41be73709 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
15562024-09-03T23:52:18.826ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2226 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 70e0029f-5d5f-4b9a-aa60-dcc41be73709 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
15572024-09-03T23:52:19.243ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 5 reason = Timeout
15582024-09-03T23:52:19.243ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15592024-09-03T23:52:19.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15602024-09-03T23:52:19.246ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15612024-09-03T23:52:19.249ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
15622024-09-03T23:52:19.249ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15632024-09-03T23:52:19.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15642024-09-03T23:52:19.250ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 5 reason = Timeout
15652024-09-03T23:52:19.250ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15662024-09-03T23:52:19.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15672024-09-03T23:52:19.250ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15682024-09-03T23:52:19.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15692024-09-03T23:52:19.252ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15702024-09-03T23:52:19.254ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b1196b3e-aa3c-4486-a0ad-52f372819a8f, lookup_type: ById(b1196b3e-aa3c-4486-a0ad-52f372819a8f) } result = Ok(())
15712024-09-03T23:52:19.254ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15722024-09-03T23:52:19.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15732024-09-03T23:52:19.263ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b1196b3e-aa3c-4486-a0ad-52f372819a8f original_time_created = 2024-09-03 23:51:19.204380 UTC target_id = b1196b3e-aa3c-4486-a0ad-52f372819a8f time_created = 2024-09-03 23:51:19.204380 UTC
15742024-09-03T23:52:19.263ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.414878ms iteration = 5 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b1196b3e-aa3c-4486-a0ad-52f372819a8f","time_created":"2024-09-03T23:51:19.204380Z"}
15752024-09-03T23:52:19.373ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15762024-09-03T23:52:19.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15772024-09-03T23:52:19.407ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 157.067372ms iteration = 5 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
15782024-09-03T23:52:19.844ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 695fce8d-a359-4d50-af41-d3e0ac9a3094 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
15792024-09-03T23:52:19.845ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 695fce8d-a359-4d50-af41-d3e0ac9a3094 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
15802024-09-03T23:52:19.846ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2104 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 695fce8d-a359-4d50-af41-d3e0ac9a3094 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
15812024-09-03T23:52:20.865ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = e36ae0f7-97cc-4d29-bbe4-bf6c59c09859 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
15822024-09-03T23:52:20.866ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = e36ae0f7-97cc-4d29-bbe4-bf6c59c09859 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
15832024-09-03T23:52:20.868ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2724 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = e36ae0f7-97cc-4d29-bbe4-bf6c59c09859 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
15842024-09-03T23:52:21.887ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 9401d3d1-f225-45b6-b35d-194b2b4957a7 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
15852024-09-03T23:52:21.887ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 9401d3d1-f225-45b6-b35d-194b2b4957a7 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
15862024-09-03T23:52:21.888ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1492 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 9401d3d1-f225-45b6-b35d-194b2b4957a7 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
15872024-09-03T23:52:22.907ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 867280d4-de5c-4d3d-9432-445154f4ae6e roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
15882024-09-03T23:52:22.907ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 867280d4-de5c-4d3d-9432-445154f4ae6e resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
15892024-09-03T23:52:22.909ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3185 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 867280d4-de5c-4d3d-9432-445154f4ae6e response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
15902024-09-03T23:52:23.930ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 0fe50641-6372-482b-8223-73a5a5cc0fd6 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
15912024-09-03T23:52:23.930ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 0fe50641-6372-482b-8223-73a5a5cc0fd6 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
15922024-09-03T23:52:23.932ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2294 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 0fe50641-6372-482b-8223-73a5a5cc0fd6 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
15932024-09-03T23:52:24.951ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 05493586-0822-4309-91ce-eeb2961109f7 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
15942024-09-03T23:52:24.951ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 05493586-0822-4309-91ce-eeb2961109f7 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
15952024-09-03T23:52:24.953ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1984 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 05493586-0822-4309-91ce-eeb2961109f7 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
15962024-09-03T23:52:25.974ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 2951497c-ffeb-4864-84a0-9ec1df433275 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
15972024-09-03T23:52:25.974ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 2951497c-ffeb-4864-84a0-9ec1df433275 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
15982024-09-03T23:52:25.976ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2536 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 2951497c-ffeb-4864-84a0-9ec1df433275 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
15992024-09-03T23:52:26.996ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = d7b72d3e-9bef-46a0-9bb0-2194ec363f5e roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
16002024-09-03T23:52:26.996ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = d7b72d3e-9bef-46a0-9bb0-2194ec363f5e resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
16012024-09-03T23:52:26.998ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1970 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = d7b72d3e-9bef-46a0-9bb0-2194ec363f5e response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
16022024-09-03T23:52:28.018ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 6326f5b4-0f2b-4e5b-a863-eb661a877025 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
16032024-09-03T23:52:28.019ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 6326f5b4-0f2b-4e5b-a863-eb661a877025 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
16042024-09-03T23:52:28.021ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2335 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 6326f5b4-0f2b-4e5b-a863-eb661a877025 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
16052024-09-03T23:52:29.040ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = ef6bd14d-460c-487c-b084-4ed2a5a38d58 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
16062024-09-03T23:52:29.041ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = ef6bd14d-460c-487c-b084-4ed2a5a38d58 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
16072024-09-03T23:52:29.042ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2203 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = ef6bd14d-460c-487c-b084-4ed2a5a38d58 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
16082024-09-03T23:52:29.244ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 6 reason = Timeout
16092024-09-03T23:52:29.244ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16102024-09-03T23:52:29.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16112024-09-03T23:52:29.246ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16122024-09-03T23:52:29.249ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
16132024-09-03T23:52:29.249ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16142024-09-03T23:52:29.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16152024-09-03T23:52:29.249ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 6 reason = Timeout
16162024-09-03T23:52:29.249ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16172024-09-03T23:52:29.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16182024-09-03T23:52:29.251ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16192024-09-03T23:52:29.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16202024-09-03T23:52:29.251ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16212024-09-03T23:52:29.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16222024-09-03T23:52:29.252ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16232024-09-03T23:52:29.255ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b1196b3e-aa3c-4486-a0ad-52f372819a8f, lookup_type: ById(b1196b3e-aa3c-4486-a0ad-52f372819a8f) } result = Ok(())
16242024-09-03T23:52:29.255ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16252024-09-03T23:52:29.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16262024-09-03T23:52:29.264ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b1196b3e-aa3c-4486-a0ad-52f372819a8f original_time_created = 2024-09-03 23:51:19.204380 UTC target_id = b1196b3e-aa3c-4486-a0ad-52f372819a8f time_created = 2024-09-03 23:51:19.204380 UTC
16272024-09-03T23:52:29.264ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.183555ms iteration = 6 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b1196b3e-aa3c-4486-a0ad-52f372819a8f","time_created":"2024-09-03T23:51:19.204380Z"}
16282024-09-03T23:52:29.279ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.545986ms iteration = 6 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
16292024-09-03T23:52:30.062ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 179045c7-411f-4a43-b35d-e9941461b57f roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
16302024-09-03T23:52:30.062ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 179045c7-411f-4a43-b35d-e9941461b57f resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
16312024-09-03T23:52:30.064ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2412 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 179045c7-411f-4a43-b35d-e9941461b57f response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
16322024-09-03T23:52:31.084ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 1141beb2-72b8-4146-9654-b0b0074f3947 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
16332024-09-03T23:52:31.085ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 1141beb2-72b8-4146-9654-b0b0074f3947 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
16342024-09-03T23:52:31.086ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2029 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 1141beb2-72b8-4146-9654-b0b0074f3947 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
16352024-09-03T23:52:32.105ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 199c0dc6-fec2-4943-bfcb-a6a4e6ab57e6 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
16362024-09-03T23:52:32.105ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 199c0dc6-fec2-4943-bfcb-a6a4e6ab57e6 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
16372024-09-03T23:52:32.107ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1971 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 199c0dc6-fec2-4943-bfcb-a6a4e6ab57e6 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
16382024-09-03T23:52:33.128ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 2dcf1655-478c-40b4-a7fa-13051b128e43 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
16392024-09-03T23:52:33.128ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 2dcf1655-478c-40b4-a7fa-13051b128e43 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
16402024-09-03T23:52:33.130ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2789 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 2dcf1655-478c-40b4-a7fa-13051b128e43 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
16412024-09-03T23:52:34.149ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = b3ee8e1e-8a25-43b4-92ee-151566cdf7d3 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
16422024-09-03T23:52:34.149ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = b3ee8e1e-8a25-43b4-92ee-151566cdf7d3 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
16432024-09-03T23:52:34.245ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 96189 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = b3ee8e1e-8a25-43b4-92ee-151566cdf7d3 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
16442024-09-03T23:52:35.264ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 9e4e3b06-2366-402a-a4f1-7cf654d0a82c roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
16452024-09-03T23:52:35.264ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 9e4e3b06-2366-402a-a4f1-7cf654d0a82c resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
16462024-09-03T23:52:35.370ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 106395 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 9e4e3b06-2366-402a-a4f1-7cf654d0a82c response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
16472024-09-03T23:52:36.391ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 48a954bf-d77c-469f-8a2d-32124a4cff75 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
16482024-09-03T23:52:36.391ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 48a954bf-d77c-469f-8a2d-32124a4cff75 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
16492024-09-03T23:52:36.392ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1885 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 48a954bf-d77c-469f-8a2d-32124a4cff75 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
16502024-09-03T23:52:37.414ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 7f8d02ad-631a-4008-a34e-b0c043a8325c roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
16512024-09-03T23:52:37.414ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 7f8d02ad-631a-4008-a34e-b0c043a8325c resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
16522024-09-03T23:52:37.512ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 98586 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 7f8d02ad-631a-4008-a34e-b0c043a8325c response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
16532024-09-03T23:52:38.532ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 60aad0d2-1903-4028-b690-37358101c18b roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
16542024-09-03T23:52:38.532ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 60aad0d2-1903-4028-b690-37358101c18b resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
16552024-09-03T23:52:38.633ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 101137 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 60aad0d2-1903-4028-b690-37358101c18b response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
16562024-09-03T23:52:39.243ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 2 reason = Timeout
16572024-09-03T23:52:39.243ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
16582024-09-03T23:52:39.243ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 7 reason = Timeout
16592024-09-03T23:52:39.243ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
16602024-09-03T23:52:39.243ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 2 reason = Timeout
16612024-09-03T23:52:39.243ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16622024-09-03T23:52:39.243ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 3 reason = Timeout
16632024-09-03T23:52:39.243ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
16642024-09-03T23:52:39.243ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 15.52\u{b5}s iteration = 3 status = {"error":"no config"}
16652024-09-03T23:52:39.243ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 2 reason = Timeout
16662024-09-03T23:52:39.243ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 3 reason = Timeout
16672024-09-03T23:52:39.243ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 2 reason = Timeout
16682024-09-03T23:52:39.243ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = b1196b3e-aa3c-4486-a0ad-52f372819a8f
16692024-09-03T23:52:39.243ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
16702024-09-03T23:52:39.243ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 3 reason = Timeout
16712024-09-03T23:52:39.243ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 28.791\u{b5}s iteration = 3 status = {"enabled":false,"target_id":"b1196b3e-aa3c-4486-a0ad-52f372819a8f"}
16722024-09-03T23:52:39.243ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
16732024-09-03T23:52:39.243ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 3 reason = Timeout
16742024-09-03T23:52:39.243ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 3 reason = Timeout
16752024-09-03T23:52:39.243ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
16762024-09-03T23:52:39.243ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 2 reason = Timeout
16772024-09-03T23:52:39.243ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 7.32\u{b5}s iteration = 3 status = {"error":"no config"}
16782024-09-03T23:52:39.243ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
16792024-09-03T23:52:39.243ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 2 reason = Timeout
16802024-09-03T23:52:39.243ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-09-03 23:42:39.243799477 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
16812024-09-03T23:52:39.243ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
16822024-09-03T23:52:39.243ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
16832024-09-03T23:52:39.243ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 3 reason = Timeout
16842024-09-03T23:52:39.243ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
16852024-09-03T23:52:39.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
16862024-09-03T23:52:39.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16872024-09-03T23:52:39.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
16882024-09-03T23:52:39.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
16892024-09-03T23:52:39.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
16902024-09-03T23:52:39.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
16912024-09-03T23:52:39.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
16922024-09-03T23:52:39.244ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1f2af9fb-1e02-483c-afd2-2b8742b46afd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("90a0c753-ce30-4bd3-a374-17c504cb8aee.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("90a0c753-ce30-4bd3-a374-17c504cb8aee.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1137, tv_nsec: 746346008 } })
16932024-09-03T23:52:39.244ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("321ab50f-2ef5-4620-bbd0-13eba6f06554.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("32795d59-c08e-49d2-b2b0-79f550835c9d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a7781486-6706-487a-a86f-e75908a89f03.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("a7781486-6706-487a-a86f-e75908a89f03.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1137, tv_nsec: 746554112 } })
16942024-09-03T23:52:39.244ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
16952024-09-03T23:52:39.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
16962024-09-03T23:52:39.246ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 3 reason = Timeout
16972024-09-03T23:52:39.246ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16982024-09-03T23:52:39.246ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 5 reason = Timeout
16992024-09-03T23:52:39.246ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
17002024-09-03T23:52:39.246ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 3 reason = Timeout
17012024-09-03T23:52:39.246ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17022024-09-03T23:52:39.246ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 3 reason = Timeout
17032024-09-03T23:52:39.246ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 2 reason = Timeout
17042024-09-03T23:52:39.246ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
17052024-09-03T23:52:39.246ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 3 reason = Timeout
17062024-09-03T23:52:39.246ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
17072024-09-03T23:52:39.246ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
17082024-09-03T23:52:39.246ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17092024-09-03T23:52:39.246ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
17102024-09-03T23:52:39.246ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 2.491304ms iteration = 2 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
17112024-09-03T23:52:39.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
17122024-09-03T23:52:39.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17132024-09-03T23:52:39.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
17142024-09-03T23:52:39.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
17152024-09-03T23:52:39.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17162024-09-03T23:52:39.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17172024-09-03T23:52:39.247ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
17182024-09-03T23:52:39.247ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 3.650889ms iteration = 2 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
17192024-09-03T23:52:39.248ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
17202024-09-03T23:52:39.248ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17212024-09-03T23:52:39.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
17222024-09-03T23:52:39.248ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17232024-09-03T23:52:39.248ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.211052ms iteration = 3 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
17242024-09-03T23:52:39.250ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 2 reason = Timeout
17252024-09-03T23:52:39.250ZINFOnexus (BackgroundTasks): Abandoned VMM reaper running background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:76
17262024-09-03T23:52:39.250ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
17272024-09-03T23:52:39.250ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 3 reason = Timeout
17282024-09-03T23:52:39.250ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
17292024-09-03T23:52:39.250ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 7 reason = Timeout
17302024-09-03T23:52:39.250ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17312024-09-03T23:52:39.250ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 3 reason = Timeout
17322024-09-03T23:52:39.250ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
17332024-09-03T23:52:39.250ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
17342024-09-03T23:52:39.250ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 3 reason = Timeout
17352024-09-03T23:52:39.250ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
17362024-09-03T23:52:39.250ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 3 reason = Timeout
17372024-09-03T23:52:39.250ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
17382024-09-03T23:52:39.250ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 3 reason = Timeout
17392024-09-03T23:52:39.250ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
17402024-09-03T23:52:39.250ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 2 reason = Timeout
17412024-09-03T23:52:39.250ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
17422024-09-03T23:52:39.250ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 3 reason = Timeout
17432024-09-03T23:52:39.250ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 3 reason = Timeout
17442024-09-03T23:52:39.250ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
17452024-09-03T23:52:39.250ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17462024-09-03T23:52:39.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
17472024-09-03T23:52:39.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
17482024-09-03T23:52:39.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
17492024-09-03T23:52:39.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17502024-09-03T23:52:39.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
17512024-09-03T23:52:39.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
17522024-09-03T23:52:39.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
17532024-09-03T23:52:39.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
17542024-09-03T23:52:39.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
17552024-09-03T23:52:39.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17562024-09-03T23:52:39.251ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
17572024-09-03T23:52:39.251ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b281022b-35b2-452e-ad2b-78e12f6ca16a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b281022b-35b2-452e-ad2b-78e12f6ca16a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1137, tv_nsec: 753196595 } })
17582024-09-03T23:52:39.251ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
17592024-09-03T23:52:39.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
17602024-09-03T23:52:39.251ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
17612024-09-03T23:52:39.251ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17622024-09-03T23:52:39.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17632024-09-03T23:52:39.252ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
17642024-09-03T23:52:39.253ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17652024-09-03T23:52:39.253ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17662024-09-03T23:52:39.254ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17672024-09-03T23:52:39.256ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
17682024-09-03T23:52:39.256ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
17692024-09-03T23:52:39.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
17702024-09-03T23:52:39.256ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b281022b-35b2-452e-ad2b-78e12f6ca16a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b281022b-35b2-452e-ad2b-78e12f6ca16a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1137, tv_nsec: 758711694 } })
17712024-09-03T23:52:39.257ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
17722024-09-03T23:52:39.257ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17732024-09-03T23:52:39.257ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
17742024-09-03T23:52:39.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17752024-09-03T23:52:39.258ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
17762024-09-03T23:52:39.260ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17772024-09-03T23:52:39.260ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17782024-09-03T23:52:39.261ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17792024-09-03T23:52:39.263ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
17802024-09-03T23:52:39.263ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
17812024-09-03T23:52:39.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
17822024-09-03T23:52:39.263ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
17832024-09-03T23:52:39.263ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17842024-09-03T23:52:39.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17852024-09-03T23:52:39.264ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
17862024-09-03T23:52:39.265ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17872024-09-03T23:52:39.265ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17882024-09-03T23:52:39.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17892024-09-03T23:52:39.266ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
17902024-09-03T23:52:39.266ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
17912024-09-03T23:52:39.266ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 16.638058ms iteration = 2 status = {"error":null,"error_count":0,"found":0,"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0}
17922024-09-03T23:52:39.267ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
17932024-09-03T23:52:39.267ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
17942024-09-03T23:52:39.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
17952024-09-03T23:52:39.271ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 20.672345ms iteration = 2 status = {"errors":[],"found_port_ok":[]}
17962024-09-03T23:52:39.271ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17972024-09-03T23:52:39.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17982024-09-03T23:52:39.272ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
17992024-09-03T23:52:39.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
18002024-09-03T23:52:39.273ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
18012024-09-03T23:52:39.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
18022024-09-03T23:52:39.274ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b281022b-35b2-452e-ad2b-78e12f6ca16a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b281022b-35b2-452e-ad2b-78e12f6ca16a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1137, tv_nsec: 776554418 } })
18032024-09-03T23:52:39.275ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df
18042024-09-03T23:52:39.286ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18052024-09-03T23:52:39.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18062024-09-03T23:52:39.299ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
18072024-09-03T23:52:39.299ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
18082024-09-03T23:52:39.299ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
18092024-09-03T23:52:39.299ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
18102024-09-03T23:52:39.299ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
18112024-09-03T23:52:39.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
18122024-09-03T23:52:39.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
18132024-09-03T23:52:39.302ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 56.860095ms iteration = 3 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
18142024-09-03T23:52:39.308ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18152024-09-03T23:52:39.310ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
18162024-09-03T23:52:39.310ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18172024-09-03T23:52:39.310ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
18182024-09-03T23:52:39.310ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
18192024-09-03T23:52:39.310ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
18202024-09-03T23:52:39.310ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
18212024-09-03T23:52:39.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18222024-09-03T23:52:39.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
18232024-09-03T23:52:39.312ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18242024-09-03T23:52:39.313ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 62.795933ms iteration = 3 status = {"errors":[],"garbage_collect_requested":[]}
18252024-09-03T23:52:39.313ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18262024-09-03T23:52:39.315ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
18272024-09-03T23:52:39.315ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18282024-09-03T23:52:39.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18292024-09-03T23:52:39.317ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
18302024-09-03T23:52:39.317ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
18312024-09-03T23:52:39.317ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:56
18322024-09-03T23:52:39.317ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
18332024-09-03T23:52:39.317ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
18342024-09-03T23:52:39.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
18352024-09-03T23:52:39.317ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18362024-09-03T23:52:39.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
18372024-09-03T23:52:39.318ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
18382024-09-03T23:52:39.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18392024-09-03T23:52:39.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
18402024-09-03T23:52:39.318ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 68.570167ms iteration = 3 status = {"errors":[],"records_set_to_done":[]}
18412024-09-03T23:52:39.321ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 71.170603ms iteration = 7 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
18422024-09-03T23:52:39.322ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:56
18432024-09-03T23:52:39.322ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
18442024-09-03T23:52:39.322ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
18452024-09-03T23:52:39.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
18462024-09-03T23:52:39.323ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18472024-09-03T23:52:39.324ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18482024-09-03T23:52:39.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18492024-09-03T23:52:39.325ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18502024-09-03T23:52:39.326ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
18512024-09-03T23:52:39.326ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 35395b13-f2fe-45cc-ba7e-90fa45dea705 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
18522024-09-03T23:52:39.326ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
18532024-09-03T23:52:39.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
18542024-09-03T23:52:39.327ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
18552024-09-03T23:52:39.327ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
18562024-09-03T23:52:39.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
18572024-09-03T23:52:39.328ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
18582024-09-03T23:52:39.328ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
18592024-09-03T23:52:39.328ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
18602024-09-03T23:52:39.329ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18612024-09-03T23:52:39.329ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
18622024-09-03T23:52:39.329ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
18632024-09-03T23:52:39.331ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
18642024-09-03T23:52:39.331ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
18652024-09-03T23:52:39.331ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 85.159223ms iteration = 2 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
18662024-09-03T23:52:39.332ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b1196b3e-aa3c-4486-a0ad-52f372819a8f, lookup_type: ById(b1196b3e-aa3c-4486-a0ad-52f372819a8f) } result = Ok(())
18672024-09-03T23:52:39.332ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18682024-09-03T23:52:39.332ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18692024-09-03T23:52:39.340ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18702024-09-03T23:52:39.341ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
18712024-09-03T23:52:39.341ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
18722024-09-03T23:52:39.341ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "59734b73-933f-41d5-8142-10c3f92c58b7", "content-length": "26", "date": "Tue, 03 Sep 2024 23:52:39 GMT"} })
18732024-09-03T23:52:39.341ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
18742024-09-03T23:52:39.343ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
18752024-09-03T23:52:39.343ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
18762024-09-03T23:52:39.343ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
18772024-09-03T23:52:39.343ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
18782024-09-03T23:52:39.344ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b1196b3e-aa3c-4486-a0ad-52f372819a8f original_time_created = 2024-09-03 23:51:19.204380 UTC target_id = b1196b3e-aa3c-4486-a0ad-52f372819a8f time_created = 2024-09-03 23:51:19.204380 UTC
18792024-09-03T23:52:39.344ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 100.633407ms iteration = 7 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b1196b3e-aa3c-4486-a0ad-52f372819a8f","time_created":"2024-09-03T23:51:19.204380Z"}
18802024-09-03T23:52:39.346ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
18812024-09-03T23:52:39.346ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 3d837478-6c27-4614-b539-014b54fe9c3e dns_zone_name = oxide.test found_so_far = 0 version = 2
18822024-09-03T23:52:39.346ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
18832024-09-03T23:52:39.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
18842024-09-03T23:52:39.348ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-09-03 23:42:39.243799477 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
18852024-09-03T23:52:39.348ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 104.616023ms iteration = 2 status = {"expiration":"2024-09-03T23:42:39.243799477Z","pruned":[]}
18862024-09-03T23:52:39.357ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
18872024-09-03T23:52:39.357ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
18882024-09-03T23:52:39.358ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "7664ca66-a045-4654-b59c-8e2316c1ed54", "content-length": "26", "date": "Tue, 03 Sep 2024 23:52:39 GMT"} })
18892024-09-03T23:52:39.358ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
18902024-09-03T23:52:39.360ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
18912024-09-03T23:52:39.360ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:56
18922024-09-03T23:52:39.360ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:241 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
18932024-09-03T23:52:39.361ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 110.623182ms iteration = 3 status = {"destroyed_active_vmms":0,"error":null,"failed_active_vmms":0,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
18942024-09-03T23:52:39.363ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18952024-09-03T23:52:39.364ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
18962024-09-03T23:52:39.365ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
18972024-09-03T23:52:39.366ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: b281022b-35b2-452e-ad2b-78e12f6ca16a, lookup_type: ById(b281022b-35b2-452e-ad2b-78e12f6ca16a) } result = Ok(())
18982024-09-03T23:52:39.366ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18992024-09-03T23:52:39.368ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19002024-09-03T23:52:39.368ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 117.880078ms iteration = 3 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
19012024-09-03T23:52:39.369ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19022024-09-03T23:52:39.372ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
19032024-09-03T23:52:39.372ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
19042024-09-03T23:52:39.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
19052024-09-03T23:52:39.373ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 127.024546ms iteration = 3 status = 0
19062024-09-03T23:52:39.374ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df zone_address = fd00:1122:3344:101::2
19072024-09-03T23:52:39.374ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
19082024-09-03T23:52:39.374ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
19092024-09-03T23:52:39.374ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "90c5bc91-51e8-4782-a506-08f475db18bb", "content-length": "26", "date": "Tue, 03 Sep 2024 23:52:39 GMT"} })
19102024-09-03T23:52:39.374ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
19112024-09-03T23:52:39.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
19122024-09-03T23:52:39.376ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df
19132024-09-03T23:52:39.377ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19142024-09-03T23:52:39.378ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 132.82577ms iteration = 5 status = {"physical_disks_added":0}
19152024-09-03T23:52:39.378ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 35395b13-f2fe-45cc-ba7e-90fa45dea705 dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
19162024-09-03T23:52:39.379ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
19172024-09-03T23:52:39.379ZINFOnexus (BackgroundTasks): found latest generation (first find) background_task = dns_config_internal dns_group = internal file = nexus/src/app/background/tasks/dns_config.rs:87 generation = 1
19182024-09-03T23:52:39.379ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 135.310364ms iteration = 2 status = {"generation":1}
19192024-09-03T23:52:39.379ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 4 reason = Dependency
19202024-09-03T23:52:39.381ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
19212024-09-03T23:52:39.381ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
19222024-09-03T23:52:39.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
19232024-09-03T23:52:39.390ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19242024-09-03T23:52:39.390ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19252024-09-03T23:52:39.391ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 3d837478-6c27-4614-b539-014b54fe9c3e dns_zone_name = oxide.test found_so_far = 1 version = 2
19262024-09-03T23:52:39.391ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
19272024-09-03T23:52:39.391ZINFOnexus (BackgroundTasks): found latest generation (first find) background_task = dns_config_external dns_group = external file = nexus/src/app/background/tasks/dns_config.rs:87 generation = 2
19282024-09-03T23:52:39.391ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 147.437135ms iteration = 2 status = {"generation":2}
19292024-09-03T23:52:39.391ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 4 reason = Dependency
19302024-09-03T23:52:39.406ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19312024-09-03T23:52:39.408ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
19322024-09-03T23:52:39.408ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
19332024-09-03T23:52:39.408ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
19342024-09-03T23:52:39.409ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:480 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
19352024-09-03T23:52:39.409ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 159.165108ms iteration = 3 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
19362024-09-03T23:52:39.417ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 167.007726ms iteration = 3 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
19372024-09-03T23:52:39.474ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 231.169428ms iteration = 3 status = {}
19382024-09-03T23:52:39.487ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (initial) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-09-03T23:51:37.486746Z, time_modified: 2024-09-03T23:51:37.486746Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 8448d8a2-33e4-4746-ac02-db97b8df3ca4, db_silo: Silo { identity: SiloIdentity { id: 8448d8a2-33e4-4746-ac02-db97b8df3ca4, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-09-03T23:51:42.648012Z, time_modified: 2024-09-03T23:51:42.648012Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "294cc86510f94c68a456b8ade6786c3fe5efad002008ff9982b0149d3f4d8d7a" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 8448d8a2-33e4-4746-ac02-db97b8df3ca4, db_silo: Silo { identity: SiloIdentity { id: 8448d8a2-33e4-4746-ac02-db97b8df3ca4, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-09-03T23:51:42.648012Z, time_modified: 2024-09-03T23:51:42.648012Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "294cc86510f94c68a456b8ade6786c3fe5efad002008ff9982b0149d3f4d8d7a" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:77
19392024-09-03T23:52:39.487ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 243.34386ms iteration = 2 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"8448d8a2-33e4-4746-ac02-db97b8df3ca4","tls_certs":["294cc86510f94c68a456b8ade6786c3fe5efad002008ff9982b0149d3f4d8d7a"]}},"default_endpoint":{"silo_id":"8448d8a2-33e4-4746-ac02-db97b8df3ca4","tls_certs":["294cc86510f94c68a456b8ade6786c3fe5efad002008ff9982b0149d3f4d8d7a"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
19402024-09-03T23:52:39.497ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19412024-09-03T23:52:39.497ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
19422024-09-03T23:52:39.497ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19432024-09-03T23:52:39.497ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "372e0cbe-6a4f-48df-ae7a-61cddf3237d2", "content-length": "1", "date": "Tue, 03 Sep 2024 23:52:39 GMT"} })
19442024-09-03T23:52:39.499ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
19452024-09-03T23:52:39.499ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19462024-09-03T23:52:39.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
19472024-09-03T23:52:39.503ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
19482024-09-03T23:52:39.503ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19492024-09-03T23:52:39.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19502024-09-03T23:52:39.504ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 260.382988ms iteration = 3 status = null
19512024-09-03T23:52:39.506ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
19522024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /
19532024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /access
19542024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /assets/{path}
19552024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /device/auth
19562024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /device/confirm
19572024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /device/success
19582024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /device/token
19592024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /device/verify
19602024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /experimental/v1/probes
19612024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /experimental/v1/probes
19622024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /experimental/v1/probes/{probe}
19632024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /experimental/v1/probes/{probe}
19642024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /images
19652024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /login
19662024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /login/{silo_name}/local
19672024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /login/{silo_name}/saml/{provider_name}
19682024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /login/{silo_name}/saml/{provider_name}
19692024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /login/{silo_name}/saml/{provider_name}/redirect
19702024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /lookup/{path}
19712024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /projects/{path}
19722024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /projects-new
19732024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /settings/{path}
19742024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /system/{path}
19752024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /utilization
19762024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/certificates
19772024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/certificates
19782024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/certificates/{certificate}
19792024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/certificates/{certificate}
19802024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/disks
19812024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/disks
19822024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/disks/{disk}
19832024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/disks/{disk}
19842024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/disks/{disk}/bulk-write
19852024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/disks/{disk}/bulk-write-start
19862024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/disks/{disk}/bulk-write-stop
19872024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/disks/{disk}/finalize
19882024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/disks/{disk}/metrics/{metric}
19892024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/floating-ips
19902024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/floating-ips
19912024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/floating-ips/{floating_ip}
19922024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/floating-ips/{floating_ip}
19932024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/floating-ips/{floating_ip}
19942024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/floating-ips/{floating_ip}/attach
19952024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/floating-ips/{floating_ip}/detach
19962024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/groups
19972024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/groups/{group_id}
19982024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/images
19992024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/images
20002024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/images/{image}
20012024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/images/{image}
20022024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/images/{image}/demote
20032024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/images/{image}/promote
20042024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances
20052024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances
20062024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/instances/{instance}
20072024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance}
20082024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance}/disks
20092024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/disks/attach
20102024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/disks/detach
20112024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance}/external-ips
20122024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/instances/{instance}/external-ips/ephemeral
20132024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/external-ips/ephemeral
20142024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/reboot
20152024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance}/serial-console
20162024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance}/serial-console/stream
20172024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance}/ssh-public-keys
20182024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/start
20192024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/stop
20202024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/ip-pools
20212024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/ip-pools/{pool}
20222024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/login/{silo_name}/local
20232024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/logout
20242024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/me
20252024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/me/groups
20262024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/me/ssh-keys
20272024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/me/ssh-keys
20282024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/me/ssh-keys/{ssh_key}
20292024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/me/ssh-keys/{ssh_key}
20302024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/metrics/{metric_name}
20312024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/network-interfaces
20322024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/network-interfaces
20332024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/network-interfaces/{interface}
20342024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/network-interfaces/{interface}
20352024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/network-interfaces/{interface}
20362024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/ping
20372024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/policy
20382024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/policy
20392024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/projects
20402024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/projects
20412024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/projects/{project}
20422024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/projects/{project}
20432024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/projects/{project}
20442024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/projects/{project}/policy
20452024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/projects/{project}/policy
20462024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/snapshots
20472024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/snapshots
20482024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/snapshots/{snapshot}
20492024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/snapshots/{snapshot}
20502024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/disks
20512024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/disks/{disk_id}
20522024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/racks
20532024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/racks/{rack_id}
20542024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/sleds
20552024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/hardware/sleds
20562024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/sleds/{sled_id}
20572024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/sleds/{sled_id}/disks
20582024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/sleds/{sled_id}/instances
20592024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/hardware/sleds/{sled_id}/provision-policy
20602024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/sleds-uninitialized
20612024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/switch-port
20622024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/hardware/switch-port/{port}/settings
20632024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/hardware/switch-port/{port}/settings
20642024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/switch-port/{port}/status
20652024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/switches
20662024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/switches/{switch_id}
20672024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/identity-providers
20682024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/identity-providers/local/users
20692024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/identity-providers/local/users/{user_id}
20702024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/identity-providers/local/users/{user_id}/set-password
20712024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/identity-providers/saml
20722024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/identity-providers/saml/{provider}
20732024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools
20742024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools
20752024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/ip-pools/{pool}
20762024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools/{pool}
20772024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/ip-pools/{pool}
20782024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools/{pool}/ranges
20792024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools/{pool}/ranges/add
20802024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools/{pool}/ranges/remove
20812024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools/{pool}/silos
20822024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools/{pool}/silos
20832024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/ip-pools/{pool}/silos/{silo}
20842024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/ip-pools/{pool}/silos/{silo}
20852024-09-03T23:52:39.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools/{pool}/utilization
20862024-09-03T23:52:39.530ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools-service
20872024-09-03T23:52:39.530ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools-service/ranges
20882024-09-03T23:52:39.530ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools-service/ranges/add
20892024-09-03T23:52:39.530ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools-service/ranges/remove
20902024-09-03T23:52:39.530ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/metrics/{metric_name}
20912024-09-03T23:52:39.530ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/address-lot
20922024-09-03T23:52:39.530ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/address-lot
20932024-09-03T23:52:39.530ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/networking/address-lot/{address_lot}
20942024-09-03T23:52:39.530ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/address-lot/{address_lot}/blocks
20952024-09-03T23:52:39.530ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/allow-list
20962024-09-03T23:52:39.530ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/networking/allow-list
20972024-09-03T23:52:39.530ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/bfd-disable
20982024-09-03T23:52:39.530ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/bfd-enable
20992024-09-03T23:52:39.530ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bfd-status
21002024-09-03T23:52:39.530ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/networking/bgp
21012024-09-03T23:52:39.530ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp
21022024-09-03T23:52:39.530ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/bgp
21032024-09-03T23:52:39.530ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-announce-set
21042024-09-03T23:52:39.530ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/networking/bgp-announce-set
21052024-09-03T23:52:39.530ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/networking/bgp-announce-set/{name_or_id}
21062024-09-03T23:52:39.530ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-announce-set/{name_or_id}/announcement
21072024-09-03T23:52:39.530ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-exported
21082024-09-03T23:52:39.530ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-message-history
21092024-09-03T23:52:39.530ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-routes-ipv4
21102024-09-03T23:52:39.530ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-status
21112024-09-03T23:52:39.530ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/loopback-address
21122024-09-03T23:52:39.530ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/loopback-address
21132024-09-03T23:52:39.530ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/networking/loopback-address/{rack_id}/{switch_location}/{address}/{subnet_mask}
21142024-09-03T23:52:39.530ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/networking/switch-port-settings
21152024-09-03T23:52:39.530ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/switch-port-settings
21162024-09-03T23:52:39.530ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/switch-port-settings
21172024-09-03T23:52:39.530ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/switch-port-settings/{port}
21182024-09-03T23:52:39.530ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/policy
21192024-09-03T23:52:39.530ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/policy
21202024-09-03T23:52:39.530ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/roles
21212024-09-03T23:52:39.530ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/roles/{role_name}
21222024-09-03T23:52:39.530ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silo-quotas
21232024-09-03T23:52:39.530ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silos
21242024-09-03T23:52:39.530ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/silos
21252024-09-03T23:52:39.530ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/silos/{silo}
21262024-09-03T23:52:39.530ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silos/{silo}
21272024-09-03T23:52:39.530ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silos/{silo}/ip-pools
21282024-09-03T23:52:39.530ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silos/{silo}/policy
21292024-09-03T23:52:39.530ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/silos/{silo}/policy
21302024-09-03T23:52:39.530ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silos/{silo}/quotas
21312024-09-03T23:52:39.530ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/silos/{silo}/quotas
21322024-09-03T23:52:39.530ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/update/repository
21332024-09-03T23:52:39.530ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/update/repository/{system_version}
21342024-09-03T23:52:39.530ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/users
21352024-09-03T23:52:39.530ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/users/{user_id}
21362024-09-03T23:52:39.530ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/users-builtin
21372024-09-03T23:52:39.530ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/users-builtin/{user}
21382024-09-03T23:52:39.530ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/utilization/silos
21392024-09-03T23:52:39.530ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/utilization/silos/{silo}
21402024-09-03T23:52:39.530ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/timeseries/query
21412024-09-03T23:52:39.530ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/timeseries/schema
21422024-09-03T23:52:39.530ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/users
21432024-09-03T23:52:39.530ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/utilization
21442024-09-03T23:52:39.530ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-firewall-rules
21452024-09-03T23:52:39.530ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/vpc-firewall-rules
21462024-09-03T23:52:39.530ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-router-routes
21472024-09-03T23:52:39.530ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/vpc-router-routes
21482024-09-03T23:52:39.530ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/vpc-router-routes/{route}
21492024-09-03T23:52:39.530ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-router-routes/{route}
21502024-09-03T23:52:39.530ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/vpc-router-routes/{route}
21512024-09-03T23:52:39.530ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-routers
21522024-09-03T23:52:39.530ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/vpc-routers
21532024-09-03T23:52:39.530ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/vpc-routers/{router}
21542024-09-03T23:52:39.530ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-routers/{router}
21552024-09-03T23:52:39.530ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/vpc-routers/{router}
21562024-09-03T23:52:39.530ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-subnets
21572024-09-03T23:52:39.530ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/vpc-subnets
21582024-09-03T23:52:39.530ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/vpc-subnets/{subnet}
21592024-09-03T23:52:39.530ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-subnets/{subnet}
21602024-09-03T23:52:39.530ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/vpc-subnets/{subnet}
21612024-09-03T23:52:39.530ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-subnets/{subnet}/network-interfaces
21622024-09-03T23:52:39.530ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpcs
21632024-09-03T23:52:39.530ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/vpcs
21642024-09-03T23:52:39.530ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/vpcs/{vpc}
21652024-09-03T23:52:39.530ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpcs/{vpc}
21662024-09-03T23:52:39.530ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/vpcs/{vpc}
21672024-09-03T23:52:39.530ZINFOnexus (dropshot_external): listening file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:205 local_addr = 172.30.2.7:443
21682024-09-03T23:52:39.530ZDEBGnexus (dropshot_external): successfully registered DTrace USDT probes local_addr = 172.30.2.7:443
21692024-09-03T23:52:39.534ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21702024-09-03T23:52:39.536ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
21712024-09-03T23:52:39.536ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
21722024-09-03T23:52:39.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
21732024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /
21742024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /access
21752024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /assets/{path}
21762024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /device/auth
21772024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /device/confirm
21782024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /device/success
21792024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /device/token
21802024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /device/verify
21812024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /experimental/v1/probes
21822024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /experimental/v1/probes
21832024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /experimental/v1/probes/{probe}
21842024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /experimental/v1/probes/{probe}
21852024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /images
21862024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /login
21872024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /login/{silo_name}/local
21882024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /login/{silo_name}/saml/{provider_name}
21892024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /login/{silo_name}/saml/{provider_name}
21902024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /login/{silo_name}/saml/{provider_name}/redirect
21912024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /lookup/{path}
21922024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /projects/{path}
21932024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /projects-new
21942024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /settings/{path}
21952024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /system/{path}
21962024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /utilization
21972024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/certificates
21982024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/certificates
21992024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/certificates/{certificate}
22002024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/certificates/{certificate}
22012024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/disks
22022024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/disks
22032024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/disks/{disk}
22042024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/disks/{disk}
22052024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/disks/{disk}/bulk-write
22062024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/disks/{disk}/bulk-write-start
22072024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/disks/{disk}/bulk-write-stop
22082024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/disks/{disk}/finalize
22092024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/disks/{disk}/metrics/{metric}
22102024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/floating-ips
22112024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/floating-ips
22122024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/floating-ips/{floating_ip}
22132024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/floating-ips/{floating_ip}
22142024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/floating-ips/{floating_ip}
22152024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/floating-ips/{floating_ip}/attach
22162024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/floating-ips/{floating_ip}/detach
22172024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/groups
22182024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/groups/{group_id}
22192024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/images
22202024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/images
22212024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/images/{image}
22222024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/images/{image}
22232024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/images/{image}/demote
22242024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/images/{image}/promote
22252024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances
22262024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances
22272024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/instances/{instance}
22282024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance}
22292024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance}/disks
22302024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/disks/attach
22312024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/disks/detach
22322024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance}/external-ips
22332024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/instances/{instance}/external-ips/ephemeral
22342024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/external-ips/ephemeral
22352024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/reboot
22362024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance}/serial-console
22372024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance}/serial-console/stream
22382024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance}/ssh-public-keys
22392024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/start
22402024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/stop
22412024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/ip-pools
22422024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/ip-pools/{pool}
22432024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/login/{silo_name}/local
22442024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/logout
22452024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/me
22462024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/me/groups
22472024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/me/ssh-keys
22482024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/me/ssh-keys
22492024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/me/ssh-keys/{ssh_key}
22502024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/me/ssh-keys/{ssh_key}
22512024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/metrics/{metric_name}
22522024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/network-interfaces
22532024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/network-interfaces
22542024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/network-interfaces/{interface}
22552024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/network-interfaces/{interface}
22562024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/network-interfaces/{interface}
22572024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/ping
22582024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/policy
22592024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/policy
22602024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/projects
22612024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/projects
22622024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/projects/{project}
22632024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/projects/{project}
22642024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/projects/{project}
22652024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/projects/{project}/policy
22662024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/projects/{project}/policy
22672024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/snapshots
22682024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/snapshots
22692024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/snapshots/{snapshot}
22702024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/snapshots/{snapshot}
22712024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/disks
22722024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/disks/{disk_id}
22732024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/racks
22742024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/racks/{rack_id}
22752024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/sleds
22762024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/hardware/sleds
22772024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/sleds/{sled_id}
22782024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/sleds/{sled_id}/disks
22792024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/sleds/{sled_id}/instances
22802024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/hardware/sleds/{sled_id}/provision-policy
22812024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/sleds-uninitialized
22822024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/switch-port
22832024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/hardware/switch-port/{port}/settings
22842024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/hardware/switch-port/{port}/settings
22852024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/switch-port/{port}/status
22862024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/switches
22872024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/switches/{switch_id}
22882024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/identity-providers
22892024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/identity-providers/local/users
22902024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/identity-providers/local/users/{user_id}
22912024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/identity-providers/local/users/{user_id}/set-password
22922024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/identity-providers/saml
22932024-09-03T23:52:39.537ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/identity-providers/saml/{provider}
22942024-09-03T23:52:39.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools
22952024-09-03T23:52:39.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools
22962024-09-03T23:52:39.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/ip-pools/{pool}
22972024-09-03T23:52:39.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools/{pool}
22982024-09-03T23:52:39.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/ip-pools/{pool}
22992024-09-03T23:52:39.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools/{pool}/ranges
23002024-09-03T23:52:39.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools/{pool}/ranges/add
23012024-09-03T23:52:39.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools/{pool}/ranges/remove
23022024-09-03T23:52:39.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools/{pool}/silos
23032024-09-03T23:52:39.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools/{pool}/silos
23042024-09-03T23:52:39.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/ip-pools/{pool}/silos/{silo}
23052024-09-03T23:52:39.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/ip-pools/{pool}/silos/{silo}
23062024-09-03T23:52:39.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools/{pool}/utilization
23072024-09-03T23:52:39.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools-service
23082024-09-03T23:52:39.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools-service/ranges
23092024-09-03T23:52:39.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools-service/ranges/add
23102024-09-03T23:52:39.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools-service/ranges/remove
23112024-09-03T23:52:39.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/metrics/{metric_name}
23122024-09-03T23:52:39.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/address-lot
23132024-09-03T23:52:39.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/address-lot
23142024-09-03T23:52:39.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/networking/address-lot/{address_lot}
23152024-09-03T23:52:39.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/address-lot/{address_lot}/blocks
23162024-09-03T23:52:39.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/allow-list
23172024-09-03T23:52:39.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/networking/allow-list
23182024-09-03T23:52:39.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/bfd-disable
23192024-09-03T23:52:39.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/bfd-enable
23202024-09-03T23:52:39.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bfd-status
23212024-09-03T23:52:39.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/networking/bgp
23222024-09-03T23:52:39.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp
23232024-09-03T23:52:39.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/bgp
23242024-09-03T23:52:39.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-announce-set
23252024-09-03T23:52:39.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/networking/bgp-announce-set
23262024-09-03T23:52:39.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/networking/bgp-announce-set/{name_or_id}
23272024-09-03T23:52:39.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-announce-set/{name_or_id}/announcement
23282024-09-03T23:52:39.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-exported
23292024-09-03T23:52:39.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-message-history
23302024-09-03T23:52:39.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-routes-ipv4
23312024-09-03T23:52:39.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-status
23322024-09-03T23:52:39.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/loopback-address
23332024-09-03T23:52:39.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/loopback-address
23342024-09-03T23:52:39.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/networking/loopback-address/{rack_id}/{switch_location}/{address}/{subnet_mask}
23352024-09-03T23:52:39.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/networking/switch-port-settings
23362024-09-03T23:52:39.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/switch-port-settings
23372024-09-03T23:52:39.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/switch-port-settings
23382024-09-03T23:52:39.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/switch-port-settings/{port}
23392024-09-03T23:52:39.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/policy
23402024-09-03T23:52:39.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/policy
23412024-09-03T23:52:39.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/roles
23422024-09-03T23:52:39.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/roles/{role_name}
23432024-09-03T23:52:39.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silo-quotas
23442024-09-03T23:52:39.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silos
23452024-09-03T23:52:39.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/silos
23462024-09-03T23:52:39.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/silos/{silo}
23472024-09-03T23:52:39.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silos/{silo}
23482024-09-03T23:52:39.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silos/{silo}/ip-pools
23492024-09-03T23:52:39.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silos/{silo}/policy
23502024-09-03T23:52:39.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/silos/{silo}/policy
23512024-09-03T23:52:39.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silos/{silo}/quotas
23522024-09-03T23:52:39.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/silos/{silo}/quotas
23532024-09-03T23:52:39.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/update/repository
23542024-09-03T23:52:39.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/update/repository/{system_version}
23552024-09-03T23:52:39.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/users
23562024-09-03T23:52:39.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/users/{user_id}
23572024-09-03T23:52:39.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/users-builtin
23582024-09-03T23:52:39.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/users-builtin/{user}
23592024-09-03T23:52:39.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/utilization/silos
23602024-09-03T23:52:39.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/utilization/silos/{silo}
23612024-09-03T23:52:39.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/timeseries/query
23622024-09-03T23:52:39.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/timeseries/schema
23632024-09-03T23:52:39.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/users
23642024-09-03T23:52:39.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/utilization
23652024-09-03T23:52:39.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-firewall-rules
23662024-09-03T23:52:39.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/vpc-firewall-rules
23672024-09-03T23:52:39.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-router-routes
23682024-09-03T23:52:39.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/vpc-router-routes
23692024-09-03T23:52:39.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/vpc-router-routes/{route}
23702024-09-03T23:52:39.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-router-routes/{route}
23712024-09-03T23:52:39.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/vpc-router-routes/{route}
23722024-09-03T23:52:39.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-routers
23732024-09-03T23:52:39.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/vpc-routers
23742024-09-03T23:52:39.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/vpc-routers/{router}
23752024-09-03T23:52:39.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-routers/{router}
23762024-09-03T23:52:39.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/vpc-routers/{router}
23772024-09-03T23:52:39.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-subnets
23782024-09-03T23:52:39.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/vpc-subnets
23792024-09-03T23:52:39.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/vpc-subnets/{subnet}
23802024-09-03T23:52:39.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-subnets/{subnet}
23812024-09-03T23:52:39.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/vpc-subnets/{subnet}
23822024-09-03T23:52:39.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-subnets/{subnet}/network-interfaces
23832024-09-03T23:52:39.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpcs
23842024-09-03T23:52:39.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/vpcs
23852024-09-03T23:52:39.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/vpcs/{vpc}
23862024-09-03T23:52:39.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpcs/{vpc}
23872024-09-03T23:52:39.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/vpcs/{vpc}
23882024-09-03T23:52:39.538ZINFOnexus (dropshot_external_techport): listening file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:205 local_addr = [fd00:1122:3344:101::c]:12228
23892024-09-03T23:52:39.538ZDEBGnexus (dropshot_external_techport): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::c]:12228
23902024-09-03T23:52:39.542ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
23912024-09-03T23:52:39.542ZDEBGnexus (nexus-producer-server): registered DTrace probes
23922024-09-03T23:52:39.547ZDEBGnexus (BackgroundTasks): client request SledAgent = b281022b-35b2-452e-ad2b-78e12f6ca16a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
23932024-09-03T23:52:39.548ZDEBGnexus (BackgroundTasks): client response SledAgent = b281022b-35b2-452e-ad2b-78e12f6ca16a background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "2f5c62e9-4472-4556-aea6-de8bbd2a2c6d", "content-length": "372", "date": "Tue, 03 Sep 2024 23:52:39 GMT"} })
23942024-09-03T23:52:39.548ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23952024-09-03T23:52:39.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23962024-09-03T23:52:39.551ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23972024-09-03T23:52:39.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23982024-09-03T23:52:39.551ZDEBGnexus (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::c]:59395 method = GET path = /{producer_id}
23992024-09-03T23:52:39.555ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24002024-09-03T23:52:39.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24012024-09-03T23:52:39.558ZDEBGnexus (BackgroundTasks): client request SledAgent = b281022b-35b2-452e-ad2b-78e12f6ca16a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
24022024-09-03T23:52:39.559ZDEBGnexus (BackgroundTasks): client response SledAgent = b281022b-35b2-452e-ad2b-78e12f6ca16a background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "ff0da9a0-cc39-4c3b-adde-d14a3efc9fd8", "date": "Tue, 03 Sep 2024 23:52:39 GMT"} })
24032024-09-03T23:52:39.559ZINFOnexus (dropshot): listening file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:205 local_addr = [fd00:1122:3344:101::c]:59395
24042024-09-03T23:52:39.559ZDEBGnexus (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::c]:59395
24052024-09-03T23:52:39.559ZDEBGnexus (nexus-producer-server): Requested any available port, Dropshot server has been bound to [fd00:1122:3344:101::c]:59395
24062024-09-03T23:52:39.559ZDEBGnexus (nexus-producer-server): Nexus IP provided explicitly, will use it addr = [fd00:1122:3344:101::c]:12221
24072024-09-03T23:52:39.559ZDEBGnexus (nexus-producer-server): starting producer registration task
24082024-09-03T23:52:39.560ZINFOnexus (nexus-producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::c]:59395 file = oximeter/producer/src/lib.rs:283 interval = 10s producer_id = 5f5ce676-2064-4d97-b873-fbcbc29495de
24092024-09-03T23:52:39.560ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
24102024-09-03T23:52:39.560ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
24112024-09-03T23:52:39.561ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 310.569189ms iteration = 3 status = {}
24122024-09-03T23:52:39.609ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
24132024-09-03T23:52:39.652ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = a772cd50-ea20-4422-bda0-86f1edbc39e3 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
24142024-09-03T23:52:39.653ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = a772cd50-ea20-4422-bda0-86f1edbc39e3 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
24152024-09-03T23:52:39.654ZDEBGnexus (BackgroundTasks): client request SledAgent = b281022b-35b2-452e-ad2b-78e12f6ca16a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
24162024-09-03T23:52:39.654ZDEBGnexus (BackgroundTasks): client response SledAgent = b281022b-35b2-452e-ad2b-78e12f6ca16a background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "3da5c734-c578-4541-9d9f-515c1f9de6be", "content-length": "691", "date": "Tue, 03 Sep 2024 23:52:39 GMT"} })
24172024-09-03T23:52:39.654ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
24182024-09-03T23:52:39.654ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
24192024-09-03T23:52:39.654ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
24202024-09-03T23:52:39.656ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 410.00935ms iteration = 3 status = {}
24212024-09-03T23:52:39.656ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3886 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = a772cd50-ea20-4422-bda0-86f1edbc39e3 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
24222024-09-03T23:52:39.658ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
24232024-09-03T23:52:39.659ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "6e796121-5e22-4f22-9629-2c6ae0ea8150", "date": "Tue, 03 Sep 2024 23:52:39 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
24242024-09-03T23:52:39.659ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
24252024-09-03T23:52:39.660ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "a3a4840c-fb26-481f-a6f5-cfa4eb206655", "date": "Tue, 03 Sep 2024 23:52:39 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
24262024-09-03T23:52:39.660ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
24272024-09-03T23:52:39.661ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
24282024-09-03T23:52:39.661ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 270.818022ms iteration = 4 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
24292024-09-03T23:52:39.669ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
24302024-09-03T23:52:39.669ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:52305
24312024-09-03T23:52:39.674ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:52305 req_id = c0877f28-2d3e-409f-baf7-1508956e9ccc roles = RoleSet { roles: {} } uri = /metrics/producers
24322024-09-03T23:52:39.674ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:52305 req_id = c0877f28-2d3e-409f-baf7-1508956e9ccc resource = Database result = Ok(()) uri = /metrics/producers
24332024-09-03T23:52:39.700ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
24342024-09-03T23:52:39.700ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "9b03f83e-2bf3-4c08-a2a4-4965cbd0f504", "date": "Tue, 03 Sep 2024 23:52:39 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
24352024-09-03T23:52:39.700ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
24362024-09-03T23:52:39.702ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "0084dfd0-5cc6-4d44-9966-7d445d25a859", "date": "Tue, 03 Sep 2024 23:52:39 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
24372024-09-03T23:52:39.702ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
24382024-09-03T23:52:39.703ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "cec91b54-910a-47c6-9771-8846cac81e74", "date": "Tue, 03 Sep 2024 23:52:39 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
24392024-09-03T23:52:39.703ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
24402024-09-03T23:52:39.705ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
24412024-09-03T23:52:39.705ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 326.147084ms iteration = 4 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
24422024-09-03T23:52:39.707ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24432024-09-03T23:52:39.707ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24442024-09-03T23:52:39.710ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: ec64e2ff-6fd0-4ab3-a8fa-a8a710b73297, rack_id: 1d4636f4-828e-412a-8daf-3bda355c92df, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(ccbb015a-58a4-4f0f-8a1a-5716d0b9db06) } rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df switch_location = Switch0
24452024-09-03T23:52:39.710ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24462024-09-03T23:52:39.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24472024-09-03T23:52:39.720ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 022d3a36-e465-40ec-b1ab-e6f9700e76c8
24482024-09-03T23:52:39.720ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:52305 req_id = c0877f28-2d3e-409f-baf7-1508956e9ccc roles = RoleSet { roles: {} } uri = /metrics/producers
24492024-09-03T23:52:39.720ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:52305 req_id = c0877f28-2d3e-409f-baf7-1508956e9ccc resource = Database result = Ok(()) uri = /metrics/producers
24502024-09-03T23:52:39.758ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 022d3a36-e465-40ec-b1ab-e6f9700e76c8 uri = http://[fd00:1122:3344:101::d]:12223/producers
24512024-09-03T23:52:39.759ZDEBGnexus: client response oximeter-collector = 022d3a36-e465-40ec-b1ab-e6f9700e76c8 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "48bca788-fc5b-4227-b125-a49017f12418", "date": "Tue, 03 Sep 2024 23:52:39 GMT"} })
24522024-09-03T23:52:39.759ZINFOnexus: assigned collector to new producer collector_id = 022d3a36-e465-40ec-b1ab-e6f9700e76c8 file = nexus/src/app/oximeter.rs:125 producer_id = 5f5ce676-2064-4d97-b873-fbcbc29495de
24532024-09-03T23:52:39.769ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 99875 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:52305 req_id = c0877f28-2d3e-409f-baf7-1508956e9ccc response_code = 201 uri = /metrics/producers
24542024-09-03T23:52:39.769ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::c)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, status: 201, headers: {"content-type": "application/json", "x-request-id": "c0877f28-2d3e-409f-baf7-1508956e9ccc", "content-length": "41", "date": "Tue, 03 Sep 2024 23:52:39 GMT"} })
24552024-09-03T23:52:39.771ZDEBGnexus (producer-registration-task): registered with nexus successfully
24562024-09-03T23:52:39.771ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
24572024-09-03T23:52:39.825ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
24582024-09-03T23:52:39.827ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "1691cd7e-59cd-4c3b-9a61-bf6efbc43755", "content-length": "121", "date": "Tue, 03 Sep 2024 23:52:39 GMT"} })
24592024-09-03T23:52:39.827ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
24602024-09-03T23:52:39.827ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = ccbb015a-58a4-4f0f-8a1a-5716d0b9db06
24612024-09-03T23:52:39.827ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
24622024-09-03T23:52:39.827ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
24632024-09-03T23:52:39.827ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df routes = {}
24642024-09-03T23:52:39.827ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df routes = {}
24652024-09-03T23:52:39.827ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df
24662024-09-03T23:52:39.827ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24672024-09-03T23:52:39.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24682024-09-03T23:52:39.829ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
24692024-09-03T23:52:39.829ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "569bee98-cf14-4021-b6f7-9679a910155f", "content-length": "2", "date": "Tue, 03 Sep 2024 23:52:39 GMT"} })
24702024-09-03T23:52:39.829ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
24712024-09-03T23:52:39.830ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "19a1ad47-72a0-4898-9be2-cd2c4e80ec01", "content-length": "52", "date": "Tue, 03 Sep 2024 23:52:39 GMT"} })
24722024-09-03T23:52:39.830ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df switch_location = Switch0
24732024-09-03T23:52:39.830ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
24742024-09-03T23:52:39.997ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "bf56f741-1ee2-4e86-9f7b-5d9eb5526fc0", "date": "Tue, 03 Sep 2024 23:52:39 GMT"} })
24752024-09-03T23:52:39.997ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df switch = Switch0
24762024-09-03T23:52:39.997ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
24772024-09-03T23:52:39.997ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "18db0aff-6b70-45bb-a0b2-cf384fdeb2ec", "content-length": "667", "date": "Tue, 03 Sep 2024 23:52:39 GMT"} })
24782024-09-03T23:52:39.997ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24792024-09-03T23:52:39.998ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24802024-09-03T23:52:40.001ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24812024-09-03T23:52:40.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24822024-09-03T23:52:40.009ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24832024-09-03T23:52:40.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24842024-09-03T23:52:40.012ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24852024-09-03T23:52:40.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24862024-09-03T23:52:40.022ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 776.84988ms iteration = 3 status = {}
24872024-09-03T23:52:40.357ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50060 req_id = c4bf892c-31c8-4a4b-86d4-5804817ecd55 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
24882024-09-03T23:52:40.357ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50060 req_id = c4bf892c-31c8-4a4b-86d4-5804817ecd55 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
24892024-09-03T23:52:40.360ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3295 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50060 req_id = c4bf892c-31c8-4a4b-86d4-5804817ecd55 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
24902024-09-03T23:52:40.675ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 24d18f02-390d-4265-bbad-9d6d0505ff07 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
24912024-09-03T23:52:40.675ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 24d18f02-390d-4265-bbad-9d6d0505ff07 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
24922024-09-03T23:52:40.677ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2566 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 24d18f02-390d-4265-bbad-9d6d0505ff07 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
24932024-09-03T23:52:41.697ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 653a8f67-71f9-4205-8ab6-84bbd1a08073 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
24942024-09-03T23:52:41.697ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 653a8f67-71f9-4205-8ab6-84bbd1a08073 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
24952024-09-03T23:52:41.700ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2695 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 653a8f67-71f9-4205-8ab6-84bbd1a08073 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
24962024-09-03T23:52:42.719ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 844d6692-c345-415a-bcec-028881b6a83f roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
24972024-09-03T23:52:42.720ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 844d6692-c345-415a-bcec-028881b6a83f resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
24982024-09-03T23:52:42.721ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1785 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 844d6692-c345-415a-bcec-028881b6a83f response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
24992024-09-03T23:52:43.742ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 835af967-ac34-4b16-8178-596243076874 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
25002024-09-03T23:52:43.742ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 835af967-ac34-4b16-8178-596243076874 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
25012024-09-03T23:52:43.744ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2363 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 835af967-ac34-4b16-8178-596243076874 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
25022024-09-03T23:52:44.764ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = dadbd724-03ad-45c5-8a8e-7410d322d82d roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
25032024-09-03T23:52:44.764ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = dadbd724-03ad-45c5-8a8e-7410d322d82d resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
25042024-09-03T23:52:44.767ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2890 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = dadbd724-03ad-45c5-8a8e-7410d322d82d response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
25052024-09-03T23:52:45.787ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = c7977a7d-9ace-406a-854c-e768dec67b89 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
25062024-09-03T23:52:45.787ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = c7977a7d-9ace-406a-854c-e768dec67b89 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
25072024-09-03T23:52:45.789ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2462 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = c7977a7d-9ace-406a-854c-e768dec67b89 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
25082024-09-03T23:52:46.808ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = dced1766-e36e-4550-9806-3a0af09487d0 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
25092024-09-03T23:52:46.809ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = dced1766-e36e-4550-9806-3a0af09487d0 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
25102024-09-03T23:52:46.811ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2233 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = dced1766-e36e-4550-9806-3a0af09487d0 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
25112024-09-03T23:52:47.830ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 2ace0600-a717-499d-8bab-f58da5bd3344 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
25122024-09-03T23:52:47.831ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 2ace0600-a717-499d-8bab-f58da5bd3344 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
25132024-09-03T23:52:47.833ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2523 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 2ace0600-a717-499d-8bab-f58da5bd3344 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
25142024-09-03T23:52:48.853ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 73072a0a-296b-469f-9ad3-364d4367398a roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
25152024-09-03T23:52:48.853ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 73072a0a-296b-469f-9ad3-364d4367398a resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
25162024-09-03T23:52:48.855ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2775 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 73072a0a-296b-469f-9ad3-364d4367398a response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
25172024-09-03T23:52:49.244ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 8 reason = Timeout
25182024-09-03T23:52:49.244ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25192024-09-03T23:52:49.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25202024-09-03T23:52:49.246ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25212024-09-03T23:52:49.248ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
25222024-09-03T23:52:49.248ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25232024-09-03T23:52:49.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25242024-09-03T23:52:49.249ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 8 reason = Timeout
25252024-09-03T23:52:49.249ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25262024-09-03T23:52:49.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25272024-09-03T23:52:49.250ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25282024-09-03T23:52:49.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25292024-09-03T23:52:49.251ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25302024-09-03T23:52:49.253ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b1196b3e-aa3c-4486-a0ad-52f372819a8f, lookup_type: ById(b1196b3e-aa3c-4486-a0ad-52f372819a8f) } result = Ok(())
25312024-09-03T23:52:49.254ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25322024-09-03T23:52:49.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25332024-09-03T23:52:49.262ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b1196b3e-aa3c-4486-a0ad-52f372819a8f original_time_created = 2024-09-03 23:51:19.204380 UTC target_id = b1196b3e-aa3c-4486-a0ad-52f372819a8f time_created = 2024-09-03 23:51:19.204380 UTC
25342024-09-03T23:52:49.262ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.175801ms iteration = 8 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b1196b3e-aa3c-4486-a0ad-52f372819a8f","time_created":"2024-09-03T23:51:19.204380Z"}
25352024-09-03T23:52:49.280ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25362024-09-03T23:52:49.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25372024-09-03T23:52:49.307ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.661142ms iteration = 8 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
25382024-09-03T23:52:49.801ZINFOnexus (dropshot): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:59395 remote_addr = [fd00:1122:3344:101::d]:55949
25392024-09-03T23:52:49.807ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 5241 local_addr = [fd00:1122:3344:101::c]:59395 method = GET remote_addr = [fd00:1122:3344:101::d]:55949 req_id = e8a2213b-6c7b-493f-b838-e24a6aa78d06 response_code = 200 uri = /5f5ce676-2064-4d97-b873-fbcbc29495de
25402024-09-03T23:52:49.874ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 29a0323c-d0c6-41f1-aa2b-cc781da91790 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
25412024-09-03T23:52:49.875ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 29a0323c-d0c6-41f1-aa2b-cc781da91790 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
25422024-09-03T23:52:49.876ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2092 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 29a0323c-d0c6-41f1-aa2b-cc781da91790 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
25432024-09-03T23:52:50.896ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 61dcf32a-ec08-4488-9347-478c3997d9a2 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
25442024-09-03T23:52:50.896ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 61dcf32a-ec08-4488-9347-478c3997d9a2 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
25452024-09-03T23:52:50.898ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2392 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 61dcf32a-ec08-4488-9347-478c3997d9a2 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
25462024-09-03T23:52:51.920ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 1d6f075e-e812-4597-bf6b-abd76a3597f7 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
25472024-09-03T23:52:51.920ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 1d6f075e-e812-4597-bf6b-abd76a3597f7 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
25482024-09-03T23:52:51.921ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2240 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 1d6f075e-e812-4597-bf6b-abd76a3597f7 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
25492024-09-03T23:52:52.940ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 98f04563-b047-4cea-ac6a-2e90cc422c12 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
25502024-09-03T23:52:52.941ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 98f04563-b047-4cea-ac6a-2e90cc422c12 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
25512024-09-03T23:52:52.942ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2002 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 98f04563-b047-4cea-ac6a-2e90cc422c12 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
25522024-09-03T23:52:53.962ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 5ede892a-11d5-464d-bf37-8b03a42338b7 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
25532024-09-03T23:52:53.962ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 5ede892a-11d5-464d-bf37-8b03a42338b7 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
25542024-09-03T23:52:53.964ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2405 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 5ede892a-11d5-464d-bf37-8b03a42338b7 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
25552024-09-03T23:52:54.984ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 738a4318-af17-43a8-8cbd-32a54a2fc163 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
25562024-09-03T23:52:54.985ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 738a4318-af17-43a8-8cbd-32a54a2fc163 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
25572024-09-03T23:52:54.987ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3743 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 738a4318-af17-43a8-8cbd-32a54a2fc163 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
25582024-09-03T23:52:56.007ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = b0ccc564-393f-4dd0-9b96-0676ea5de6b3 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
25592024-09-03T23:52:56.008ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = b0ccc564-393f-4dd0-9b96-0676ea5de6b3 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
25602024-09-03T23:52:56.010ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2243 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = b0ccc564-393f-4dd0-9b96-0676ea5de6b3 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
25612024-09-03T23:52:57.031ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 8fe90b3d-7c72-478f-9fc7-4e144fe9dcd0 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
25622024-09-03T23:52:57.031ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 8fe90b3d-7c72-478f-9fc7-4e144fe9dcd0 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
25632024-09-03T23:52:57.033ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2168 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 8fe90b3d-7c72-478f-9fc7-4e144fe9dcd0 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
25642024-09-03T23:52:58.052ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 7cdbf4b9-b154-41dd-8121-037c0b16a3e4 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
25652024-09-03T23:52:58.052ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 7cdbf4b9-b154-41dd-8121-037c0b16a3e4 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
25662024-09-03T23:52:58.054ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2470 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 7cdbf4b9-b154-41dd-8121-037c0b16a3e4 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
25672024-09-03T23:52:59.074ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = acc3fe27-9420-490b-94e8-8b7eccf32c14 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
25682024-09-03T23:52:59.074ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = acc3fe27-9420-490b-94e8-8b7eccf32c14 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
25692024-09-03T23:52:59.076ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2383 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = acc3fe27-9420-490b-94e8-8b7eccf32c14 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
25702024-09-03T23:52:59.243ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 9 reason = Timeout
25712024-09-03T23:52:59.243ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25722024-09-03T23:52:59.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25732024-09-03T23:52:59.249ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 9 reason = Timeout
25742024-09-03T23:52:59.249ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25752024-09-03T23:52:59.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25762024-09-03T23:52:59.251ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25772024-09-03T23:52:59.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25782024-09-03T23:52:59.253ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.913834ms iteration = 9 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
25792024-09-03T23:52:59.272ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25802024-09-03T23:52:59.275ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
25812024-09-03T23:52:59.275ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25822024-09-03T23:52:59.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25832024-09-03T23:52:59.277ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25842024-09-03T23:52:59.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25852024-09-03T23:52:59.280ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25862024-09-03T23:52:59.283ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b1196b3e-aa3c-4486-a0ad-52f372819a8f, lookup_type: ById(b1196b3e-aa3c-4486-a0ad-52f372819a8f) } result = Ok(())
25872024-09-03T23:52:59.283ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25882024-09-03T23:52:59.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25892024-09-03T23:52:59.295ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b1196b3e-aa3c-4486-a0ad-52f372819a8f original_time_created = 2024-09-03 23:51:19.204380 UTC target_id = b1196b3e-aa3c-4486-a0ad-52f372819a8f time_created = 2024-09-03 23:51:19.204380 UTC
25902024-09-03T23:52:59.295ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 51.749174ms iteration = 9 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b1196b3e-aa3c-4486-a0ad-52f372819a8f","time_created":"2024-09-03T23:51:19.204380Z"}
25912024-09-03T23:52:59.800ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 428 local_addr = [fd00:1122:3344:101::c]:59395 method = GET remote_addr = [fd00:1122:3344:101::d]:55949 req_id = 2b58f30f-4857-46c7-97aa-a61841123130 response_code = 200 uri = /5f5ce676-2064-4d97-b873-fbcbc29495de
25922024-09-03T23:53:00.097ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 59a06c78-17d2-4a06-955d-ecbc5df4fff7 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
25932024-09-03T23:53:00.097ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 59a06c78-17d2-4a06-955d-ecbc5df4fff7 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
25942024-09-03T23:53:00.099ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2176 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 59a06c78-17d2-4a06-955d-ecbc5df4fff7 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
25952024-09-03T23:53:01.118ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 8949931d-fa1d-4df9-abdf-2d37a552a715 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
25962024-09-03T23:53:01.118ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 8949931d-fa1d-4df9-abdf-2d37a552a715 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
25972024-09-03T23:53:01.120ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1693 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 8949931d-fa1d-4df9-abdf-2d37a552a715 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
25982024-09-03T23:53:02.141ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = a8b8c97e-14dc-41db-9a5e-5361ce476624 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
25992024-09-03T23:53:02.141ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = a8b8c97e-14dc-41db-9a5e-5361ce476624 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
26002024-09-03T23:53:02.143ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3080 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = a8b8c97e-14dc-41db-9a5e-5361ce476624 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
26012024-09-03T23:53:03.162ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 85cbc4ee-265e-4a9d-9c21-ac41587d7d31 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
26022024-09-03T23:53:03.162ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 85cbc4ee-265e-4a9d-9c21-ac41587d7d31 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
26032024-09-03T23:53:03.164ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2434 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 85cbc4ee-265e-4a9d-9c21-ac41587d7d31 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
26042024-09-03T23:53:04.185ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = e2374169-7688-45a7-84fc-39e49b030004 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
26052024-09-03T23:53:04.186ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = e2374169-7688-45a7-84fc-39e49b030004 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
26062024-09-03T23:53:04.187ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2083 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = e2374169-7688-45a7-84fc-39e49b030004 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
26072024-09-03T23:53:05.206ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 737705bf-e813-4516-95e9-3300c500f988 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
26082024-09-03T23:53:05.207ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 737705bf-e813-4516-95e9-3300c500f988 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
26092024-09-03T23:53:05.209ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2647 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 737705bf-e813-4516-95e9-3300c500f988 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
26102024-09-03T23:53:06.230ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 39b9792b-5e89-4dd0-a62c-d88c7c4c22d2 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
26112024-09-03T23:53:06.230ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 39b9792b-5e89-4dd0-a62c-d88c7c4c22d2 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
26122024-09-03T23:53:06.232ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2909 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 39b9792b-5e89-4dd0-a62c-d88c7c4c22d2 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
26132024-09-03T23:53:07.251ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 9b4eaf07-aace-4be5-8a58-709ec635a5f3 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
26142024-09-03T23:53:07.251ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 9b4eaf07-aace-4be5-8a58-709ec635a5f3 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
26152024-09-03T23:53:07.253ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1940 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 9b4eaf07-aace-4be5-8a58-709ec635a5f3 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
26162024-09-03T23:53:08.273ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 1df52c25-f0c3-4441-b764-36294c787731 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
26172024-09-03T23:53:08.273ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 1df52c25-f0c3-4441-b764-36294c787731 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
26182024-09-03T23:53:08.275ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2223 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 1df52c25-f0c3-4441-b764-36294c787731 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
26192024-09-03T23:53:09.244ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 4 reason = Timeout
26202024-09-03T23:53:09.244ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 10 reason = Timeout
26212024-09-03T23:53:09.244ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 4 reason = Timeout
26222024-09-03T23:53:09.244ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
26232024-09-03T23:53:09.244ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 4 reason = Timeout
26242024-09-03T23:53:09.244ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26252024-09-03T23:53:09.244ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
26262024-09-03T23:53:09.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
26272024-09-03T23:53:09.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
26282024-09-03T23:53:09.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26292024-09-03T23:53:09.245ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 4 reason = Timeout
26302024-09-03T23:53:09.245ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 4 reason = Timeout
26312024-09-03T23:53:09.245ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26322024-09-03T23:53:09.245ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
26332024-09-03T23:53:09.245ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 6 reason = Timeout
26342024-09-03T23:53:09.245ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 4 reason = Timeout
26352024-09-03T23:53:09.245ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
26362024-09-03T23:53:09.245ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
26372024-09-03T23:53:09.245ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 4 reason = Timeout
26382024-09-03T23:53:09.245ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26392024-09-03T23:53:09.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26402024-09-03T23:53:09.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
26412024-09-03T23:53:09.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
26422024-09-03T23:53:09.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
26432024-09-03T23:53:09.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26442024-09-03T23:53:09.247ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b281022b-35b2-452e-ad2b-78e12f6ca16a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b281022b-35b2-452e-ad2b-78e12f6ca16a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1167, tv_nsec: 749300531 } })
26452024-09-03T23:53:09.247ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26462024-09-03T23:53:09.248ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.576597ms iteration = 4 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
26472024-09-03T23:53:09.248ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b281022b-35b2-452e-ad2b-78e12f6ca16a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b281022b-35b2-452e-ad2b-78e12f6ca16a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1167, tv_nsec: 750755152 } })
26482024-09-03T23:53:09.248ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
26492024-09-03T23:53:09.248ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26502024-09-03T23:53:09.249ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26512024-09-03T23:53:09.249ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 4 reason = Timeout
26522024-09-03T23:53:09.249ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
26532024-09-03T23:53:09.249ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 4 reason = Timeout
26542024-09-03T23:53:09.249ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
26552024-09-03T23:53:09.249ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
26562024-09-03T23:53:09.250ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 4 reason = Timeout
26572024-09-03T23:53:09.250ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26582024-09-03T23:53:09.250ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 10 reason = Timeout
26592024-09-03T23:53:09.250ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 4 reason = Timeout
26602024-09-03T23:53:09.250ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26612024-09-03T23:53:09.250ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
26622024-09-03T23:53:09.250ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 4 reason = Timeout
26632024-09-03T23:53:09.250ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
26642024-09-03T23:53:09.250ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 4 reason = Timeout
26652024-09-03T23:53:09.250ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 4 reason = Timeout
26662024-09-03T23:53:09.250ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
26672024-09-03T23:53:09.250ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
26682024-09-03T23:53:09.250ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
26692024-09-03T23:53:09.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
26702024-09-03T23:53:09.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
26712024-09-03T23:53:09.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26722024-09-03T23:53:09.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
26732024-09-03T23:53:09.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26742024-09-03T23:53:09.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
26752024-09-03T23:53:09.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
26762024-09-03T23:53:09.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
26772024-09-03T23:53:09.252ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
26782024-09-03T23:53:09.252ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26792024-09-03T23:53:09.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26802024-09-03T23:53:09.252ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
26812024-09-03T23:53:09.252ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
26822024-09-03T23:53:09.252ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
26832024-09-03T23:53:09.252ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26842024-09-03T23:53:09.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
26852024-09-03T23:53:09.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26862024-09-03T23:53:09.254ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 4.758752ms iteration = 4 status = {"errors":[],"records_set_to_done":[]}
26872024-09-03T23:53:09.255ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26882024-09-03T23:53:09.255ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26892024-09-03T23:53:09.257ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
26902024-09-03T23:53:09.257ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
26912024-09-03T23:53:09.257ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
26922024-09-03T23:53:09.257ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26932024-09-03T23:53:09.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
26942024-09-03T23:53:09.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26952024-09-03T23:53:09.259ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
26962024-09-03T23:53:09.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
26972024-09-03T23:53:09.260ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
26982024-09-03T23:53:09.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
26992024-09-03T23:53:09.261ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27002024-09-03T23:53:09.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27012024-09-03T23:53:09.262ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27022024-09-03T23:53:09.263ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27032024-09-03T23:53:09.266ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
27042024-09-03T23:53:09.266ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27052024-09-03T23:53:09.266ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 16.354732ms iteration = 4 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
27062024-09-03T23:53:09.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27072024-09-03T23:53:09.268ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b1196b3e-aa3c-4486-a0ad-52f372819a8f, lookup_type: ById(b1196b3e-aa3c-4486-a0ad-52f372819a8f) } result = Ok(())
27082024-09-03T23:53:09.268ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27092024-09-03T23:53:09.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27102024-09-03T23:53:09.268ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
27112024-09-03T23:53:09.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
27122024-09-03T23:53:09.290ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27132024-09-03T23:53:09.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27142024-09-03T23:53:09.293ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27152024-09-03T23:53:09.294ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 80855189-9494-42fb-8fa2-ead36d547e9b roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
27162024-09-03T23:53:09.294ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 80855189-9494-42fb-8fa2-ead36d547e9b resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
27172024-09-03T23:53:09.295ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
27182024-09-03T23:53:09.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
27192024-09-03T23:53:09.296ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
27202024-09-03T23:53:09.296ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
27212024-09-03T23:53:09.296ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2111 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 80855189-9494-42fb-8fa2-ead36d547e9b response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
27222024-09-03T23:53:09.296ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
27232024-09-03T23:53:09.299ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:56
27242024-09-03T23:53:09.299ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
27252024-09-03T23:53:09.299ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
27262024-09-03T23:53:09.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
27272024-09-03T23:53:09.315ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 65.730406ms iteration = 4 status = {"errors":[],"garbage_collect_requested":[]}
27282024-09-03T23:53:09.318ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 68.948565ms iteration = 10 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
27292024-09-03T23:53:09.323ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
27302024-09-03T23:53:09.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
27312024-09-03T23:53:09.328ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
27322024-09-03T23:53:09.328ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
27332024-09-03T23:53:09.328ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b585352b-b9bb-4ad9-8ad1-cc8a25be9616", "content-length": "26", "date": "Tue, 03 Sep 2024 23:53:09 GMT"} })
27342024-09-03T23:53:09.328ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
27352024-09-03T23:53:09.330ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
27362024-09-03T23:53:09.339ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
27372024-09-03T23:53:09.339ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
27382024-09-03T23:53:09.340ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a684297e-277c-428a-95cd-73f8145ef6bb", "content-length": "26", "date": "Tue, 03 Sep 2024 23:53:09 GMT"} })
27392024-09-03T23:53:09.340ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
27402024-09-03T23:53:09.341ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
27412024-09-03T23:53:09.359ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b281022b-35b2-452e-ad2b-78e12f6ca16a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b281022b-35b2-452e-ad2b-78e12f6ca16a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1167, tv_nsec: 861083328 } })
27422024-09-03T23:53:09.359ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df
27432024-09-03T23:53:09.365ZDEBGnexus (BackgroundTasks): client request SledAgent = b281022b-35b2-452e-ad2b-78e12f6ca16a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
27442024-09-03T23:53:09.365ZDEBGnexus (BackgroundTasks): client response SledAgent = b281022b-35b2-452e-ad2b-78e12f6ca16a background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c88add05-ded8-4a73-bb03-ba4f64c6326f", "content-length": "372", "date": "Tue, 03 Sep 2024 23:53:09 GMT"} })
27452024-09-03T23:53:09.365ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27462024-09-03T23:53:09.366ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27472024-09-03T23:53:09.368ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
27482024-09-03T23:53:09.368ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27492024-09-03T23:53:09.368ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:56
27502024-09-03T23:53:09.368ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
27512024-09-03T23:53:09.368ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
27522024-09-03T23:53:09.368ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
27532024-09-03T23:53:09.368ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
27542024-09-03T23:53:09.369ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27552024-09-03T23:53:09.369ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27562024-09-03T23:53:09.369ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27572024-09-03T23:53:09.370ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
27582024-09-03T23:53:09.370ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
27592024-09-03T23:53:09.371ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
27602024-09-03T23:53:09.371ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
27612024-09-03T23:53:09.371ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
27622024-09-03T23:53:09.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
27632024-09-03T23:53:09.372ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:480 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
27642024-09-03T23:53:09.372ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 122.318474ms iteration = 4 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
27652024-09-03T23:53:09.374ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27662024-09-03T23:53:09.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27672024-09-03T23:53:09.381ZDEBGnexus (BackgroundTasks): client request SledAgent = b281022b-35b2-452e-ad2b-78e12f6ca16a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
27682024-09-03T23:53:09.381ZDEBGnexus (BackgroundTasks): client response SledAgent = b281022b-35b2-452e-ad2b-78e12f6ca16a background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "fc78ae0f-3f81-4e32-876a-dac67634dcdb", "date": "Tue, 03 Sep 2024 23:53:09 GMT"} })
27692024-09-03T23:53:09.383ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 133.593686ms iteration = 4 status = {}
27702024-09-03T23:53:09.388ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b1196b3e-aa3c-4486-a0ad-52f372819a8f original_time_created = 2024-09-03 23:51:19.204380 UTC target_id = b1196b3e-aa3c-4486-a0ad-52f372819a8f time_created = 2024-09-03 23:51:19.204380 UTC
27712024-09-03T23:53:09.388ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 143.788236ms iteration = 10 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b1196b3e-aa3c-4486-a0ad-52f372819a8f","time_created":"2024-09-03T23:51:19.204380Z"}
27722024-09-03T23:53:09.394ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
27732024-09-03T23:53:09.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
27742024-09-03T23:53:09.396ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 146.78373ms iteration = 4 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
27752024-09-03T23:53:09.410ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 164.509812ms iteration = 6 status = {"physical_disks_added":0}
27762024-09-03T23:53:09.410ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27772024-09-03T23:53:09.411ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:56
27782024-09-03T23:53:09.411ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:241 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
27792024-09-03T23:53:09.411ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 161.503108ms iteration = 4 status = {"destroyed_active_vmms":0,"error":null,"failed_active_vmms":0,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
27802024-09-03T23:53:09.412ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
27812024-09-03T23:53:09.412ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
27822024-09-03T23:53:09.412ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
27832024-09-03T23:53:09.412ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
27842024-09-03T23:53:09.412ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
27852024-09-03T23:53:09.413ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 167.860585ms iteration = 4 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
27862024-09-03T23:53:09.422ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
27872024-09-03T23:53:09.423ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "cef2f044-0e9f-45be-b000-0ac9225ef816", "content-length": "1", "date": "Tue, 03 Sep 2024 23:53:09 GMT"} })
27882024-09-03T23:53:09.425ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
27892024-09-03T23:53:09.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
27902024-09-03T23:53:09.426ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 182.374738ms iteration = 4 status = null
27912024-09-03T23:53:09.427ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 183.006481ms iteration = 4 status = {}
27922024-09-03T23:53:09.428ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df zone_address = fd00:1122:3344:101::2
27932024-09-03T23:53:09.428ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
27942024-09-03T23:53:09.429ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "8fc34df7-ba24-4383-90b3-83601e8f4e78", "content-length": "26", "date": "Tue, 03 Sep 2024 23:53:09 GMT"} })
27952024-09-03T23:53:09.429ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
27962024-09-03T23:53:09.430ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df
27972024-09-03T23:53:09.499ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27982024-09-03T23:53:09.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27992024-09-03T23:53:09.502ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28002024-09-03T23:53:09.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28012024-09-03T23:53:09.503ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28022024-09-03T23:53:09.506ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: b281022b-35b2-452e-ad2b-78e12f6ca16a, lookup_type: ById(b281022b-35b2-452e-ad2b-78e12f6ca16a) } result = Ok(())
28032024-09-03T23:53:09.506ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28042024-09-03T23:53:09.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28052024-09-03T23:53:09.578ZDEBGnexus (BackgroundTasks): client request SledAgent = b281022b-35b2-452e-ad2b-78e12f6ca16a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
28062024-09-03T23:53:09.578ZDEBGnexus (BackgroundTasks): client response SledAgent = b281022b-35b2-452e-ad2b-78e12f6ca16a background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "54fcafdf-30f5-460d-abe9-e22ad7658d20", "content-length": "691", "date": "Tue, 03 Sep 2024 23:53:09 GMT"} })
28072024-09-03T23:53:09.578ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
28082024-09-03T23:53:09.578ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
28092024-09-03T23:53:09.578ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
28102024-09-03T23:53:09.579ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 333.950462ms iteration = 4 status = {}
28112024-09-03T23:53:09.600ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 355.115768ms iteration = 4 status = 0
28122024-09-03T23:53:09.608ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28132024-09-03T23:53:09.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28142024-09-03T23:53:09.611ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: ec64e2ff-6fd0-4ab3-a8fa-a8a710b73297, rack_id: 1d4636f4-828e-412a-8daf-3bda355c92df, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(ccbb015a-58a4-4f0f-8a1a-5716d0b9db06) } rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df switch_location = Switch0
28152024-09-03T23:53:09.611ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28162024-09-03T23:53:09.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28172024-09-03T23:53:09.620ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
28182024-09-03T23:53:09.621ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e8366f35-349e-4a90-a606-11b032cc5620", "content-length": "121", "date": "Tue, 03 Sep 2024 23:53:09 GMT"} })
28192024-09-03T23:53:09.621ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
28202024-09-03T23:53:09.621ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = ccbb015a-58a4-4f0f-8a1a-5716d0b9db06
28212024-09-03T23:53:09.621ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
28222024-09-03T23:53:09.621ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
28232024-09-03T23:53:09.621ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df routes = {}
28242024-09-03T23:53:09.621ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df routes = {}
28252024-09-03T23:53:09.621ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df
28262024-09-03T23:53:09.621ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28272024-09-03T23:53:09.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28282024-09-03T23:53:09.623ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
28292024-09-03T23:53:09.624ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e783ffde-cbcc-4131-a239-050b7d7bb47d", "content-length": "2", "date": "Tue, 03 Sep 2024 23:53:09 GMT"} })
28302024-09-03T23:53:09.624ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
28312024-09-03T23:53:09.624ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "1a68e106-ee92-4bc1-bd66-a5fa1aed740d", "content-length": "52", "date": "Tue, 03 Sep 2024 23:53:09 GMT"} })
28322024-09-03T23:53:09.624ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df switch_location = Switch0
28332024-09-03T23:53:09.624ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
28342024-09-03T23:53:09.801ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 475 local_addr = [fd00:1122:3344:101::c]:59395 method = GET remote_addr = [fd00:1122:3344:101::d]:55949 req_id = c384517d-93b0-46a8-bb4c-4306547c22b0 response_code = 200 uri = /5f5ce676-2064-4d97-b873-fbcbc29495de
28352024-09-03T23:53:09.810ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "8936f657-d12d-4ae5-98f1-3097b8677000", "date": "Tue, 03 Sep 2024 23:53:09 GMT"} })
28362024-09-03T23:53:09.810ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df switch = Switch0
28372024-09-03T23:53:09.810ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
28382024-09-03T23:53:09.810ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "caa44849-49f7-42c0-a3f8-27511c013c10", "content-length": "667", "date": "Tue, 03 Sep 2024 23:53:09 GMT"} })
28392024-09-03T23:53:09.810ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28402024-09-03T23:53:09.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28412024-09-03T23:53:09.821ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28422024-09-03T23:53:09.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28432024-09-03T23:53:09.824ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28442024-09-03T23:53:09.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28452024-09-03T23:53:09.827ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28462024-09-03T23:53:09.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28472024-09-03T23:53:09.887ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 641.932074ms iteration = 4 status = {}
28482024-09-03T23:53:10.317ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = cd1bc057-84d6-4304-816c-aaaea54081e6 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
28492024-09-03T23:53:10.317ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = cd1bc057-84d6-4304-816c-aaaea54081e6 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
28502024-09-03T23:53:10.319ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1998 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = cd1bc057-84d6-4304-816c-aaaea54081e6 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
28512024-09-03T23:53:10.392ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50060 req_id = e582b10f-6fbb-43dc-b8f9-dfd036e8b812 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
28522024-09-03T23:53:10.392ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50060 req_id = e582b10f-6fbb-43dc-b8f9-dfd036e8b812 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
28532024-09-03T23:53:10.395ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3202 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50060 req_id = e582b10f-6fbb-43dc-b8f9-dfd036e8b812 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
28542024-09-03T23:53:11.338ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = c854dbfc-6a03-4719-8064-79afb8b04b71 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
28552024-09-03T23:53:11.338ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = c854dbfc-6a03-4719-8064-79afb8b04b71 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
28562024-09-03T23:53:11.340ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2277 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = c854dbfc-6a03-4719-8064-79afb8b04b71 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
28572024-09-03T23:53:12.360ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 5595f917-1d9e-4c01-9d71-0a663e1649cf roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
28582024-09-03T23:53:12.360ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 5595f917-1d9e-4c01-9d71-0a663e1649cf resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
28592024-09-03T23:53:12.362ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2037 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 5595f917-1d9e-4c01-9d71-0a663e1649cf response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
28602024-09-03T23:53:13.381ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = e394c478-5ffd-4a30-b5b7-699d50533d9e roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
28612024-09-03T23:53:13.382ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = e394c478-5ffd-4a30-b5b7-699d50533d9e resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
28622024-09-03T23:53:13.384ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2425 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = e394c478-5ffd-4a30-b5b7-699d50533d9e response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
28632024-09-03T23:53:14.404ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = b76d72ac-f957-48d7-9457-0ec49e2d4f6c roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
28642024-09-03T23:53:14.404ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = b76d72ac-f957-48d7-9457-0ec49e2d4f6c resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
28652024-09-03T23:53:14.406ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2632 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = b76d72ac-f957-48d7-9457-0ec49e2d4f6c response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
28662024-09-03T23:53:15.425ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 5319d38c-0733-4b9b-b71c-c42b6a1cd7cd roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
28672024-09-03T23:53:15.425ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 5319d38c-0733-4b9b-b71c-c42b6a1cd7cd resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
28682024-09-03T23:53:15.427ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2237 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 5319d38c-0733-4b9b-b71c-c42b6a1cd7cd response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
28692024-09-03T23:53:16.447ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 79b01da0-938a-44dd-a99c-1418226aa692 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
28702024-09-03T23:53:16.448ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 79b01da0-938a-44dd-a99c-1418226aa692 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
28712024-09-03T23:53:16.449ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2096 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 79b01da0-938a-44dd-a99c-1418226aa692 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
28722024-09-03T23:53:17.469ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 214168d3-a5fc-4de7-8fda-11ef569be44d roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
28732024-09-03T23:53:17.469ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 214168d3-a5fc-4de7-8fda-11ef569be44d resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
28742024-09-03T23:53:17.471ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1945 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 214168d3-a5fc-4de7-8fda-11ef569be44d response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
28752024-09-03T23:53:18.490ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 4654a9b4-c272-44d6-aac2-7702181e2f78 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
28762024-09-03T23:53:18.490ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 4654a9b4-c272-44d6-aac2-7702181e2f78 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
28772024-09-03T23:53:18.492ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2016 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 4654a9b4-c272-44d6-aac2-7702181e2f78 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
28782024-09-03T23:53:19.244ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 11 reason = Timeout
28792024-09-03T23:53:19.244ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28802024-09-03T23:53:19.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28812024-09-03T23:53:19.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28822024-09-03T23:53:19.248ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
28832024-09-03T23:53:19.248ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28842024-09-03T23:53:19.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28852024-09-03T23:53:19.250ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28862024-09-03T23:53:19.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28872024-09-03T23:53:19.250ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 11 reason = Timeout
28882024-09-03T23:53:19.250ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28892024-09-03T23:53:19.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28902024-09-03T23:53:19.251ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28912024-09-03T23:53:19.254ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b1196b3e-aa3c-4486-a0ad-52f372819a8f, lookup_type: ById(b1196b3e-aa3c-4486-a0ad-52f372819a8f) } result = Ok(())
28922024-09-03T23:53:19.254ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28932024-09-03T23:53:19.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28942024-09-03T23:53:19.262ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b1196b3e-aa3c-4486-a0ad-52f372819a8f original_time_created = 2024-09-03 23:51:19.204380 UTC target_id = b1196b3e-aa3c-4486-a0ad-52f372819a8f time_created = 2024-09-03 23:51:19.204380 UTC
28952024-09-03T23:53:19.262ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.222233ms iteration = 11 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b1196b3e-aa3c-4486-a0ad-52f372819a8f","time_created":"2024-09-03T23:51:19.204380Z"}
28962024-09-03T23:53:19.278ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28972024-09-03T23:53:19.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28982024-09-03T23:53:19.279ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.040805ms iteration = 11 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
28992024-09-03T23:53:19.512ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 79a78ef4-25de-4284-b86e-494f7d0615f8 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
29002024-09-03T23:53:19.512ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 79a78ef4-25de-4284-b86e-494f7d0615f8 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
29012024-09-03T23:53:19.513ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1690 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 79a78ef4-25de-4284-b86e-494f7d0615f8 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
29022024-09-03T23:53:19.801ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 511 local_addr = [fd00:1122:3344:101::c]:59395 method = GET remote_addr = [fd00:1122:3344:101::d]:55949 req_id = 1a30a0dc-5e3b-438f-8c90-fa60ef31c43a response_code = 200 uri = /5f5ce676-2064-4d97-b873-fbcbc29495de
29032024-09-03T23:53:20.534ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = c2da7fb5-d52a-4c07-9404-ef0eb9f41228 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
29042024-09-03T23:53:20.535ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = c2da7fb5-d52a-4c07-9404-ef0eb9f41228 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
29052024-09-03T23:53:20.536ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1980 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = c2da7fb5-d52a-4c07-9404-ef0eb9f41228 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
29062024-09-03T23:53:21.556ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 6d03e896-20a5-4f3b-95e3-d37815cefbce roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
29072024-09-03T23:53:21.557ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 6d03e896-20a5-4f3b-95e3-d37815cefbce resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
29082024-09-03T23:53:21.558ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2241 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 6d03e896-20a5-4f3b-95e3-d37815cefbce response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
29092024-09-03T23:53:22.579ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 8467f41b-0675-4c8e-a61e-ec8a3b2f9da8 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
29102024-09-03T23:53:22.579ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 8467f41b-0675-4c8e-a61e-ec8a3b2f9da8 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
29112024-09-03T23:53:22.580ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2713 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 8467f41b-0675-4c8e-a61e-ec8a3b2f9da8 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
29122024-09-03T23:53:23.601ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = fc42baa2-01bd-4aff-9c6d-f589ca5f94e4 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
29132024-09-03T23:53:23.601ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = fc42baa2-01bd-4aff-9c6d-f589ca5f94e4 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
29142024-09-03T23:53:23.603ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2419 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = fc42baa2-01bd-4aff-9c6d-f589ca5f94e4 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
29152024-09-03T23:53:24.624ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = df2f9d4b-0a6b-473e-8eaf-7e9f0def6f48 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
29162024-09-03T23:53:24.625ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = df2f9d4b-0a6b-473e-8eaf-7e9f0def6f48 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
29172024-09-03T23:53:24.626ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1914 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = df2f9d4b-0a6b-473e-8eaf-7e9f0def6f48 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
29182024-09-03T23:53:25.646ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 491dfede-8a04-4eb2-8356-fe33d9bf7c41 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
29192024-09-03T23:53:25.646ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 491dfede-8a04-4eb2-8356-fe33d9bf7c41 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
29202024-09-03T23:53:25.648ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2067 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 491dfede-8a04-4eb2-8356-fe33d9bf7c41 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
29212024-09-03T23:53:26.669ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 3253ba0c-dc29-474e-900f-ef04e8c58de8 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
29222024-09-03T23:53:26.669ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 3253ba0c-dc29-474e-900f-ef04e8c58de8 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
29232024-09-03T23:53:26.671ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2510 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 3253ba0c-dc29-474e-900f-ef04e8c58de8 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
29242024-09-03T23:53:27.691ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 0d7534cd-b5cd-4168-abe2-fd318e31a569 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
29252024-09-03T23:53:27.692ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 0d7534cd-b5cd-4168-abe2-fd318e31a569 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
29262024-09-03T23:53:27.693ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2039 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 0d7534cd-b5cd-4168-abe2-fd318e31a569 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
29272024-09-03T23:53:28.713ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 71ad13f6-1fa6-44b1-bab5-00ccf3003a5e roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
29282024-09-03T23:53:28.713ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 71ad13f6-1fa6-44b1-bab5-00ccf3003a5e resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
29292024-09-03T23:53:28.715ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2899 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 71ad13f6-1fa6-44b1-bab5-00ccf3003a5e response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
29302024-09-03T23:53:29.244ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 12 reason = Timeout
29312024-09-03T23:53:29.244ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29322024-09-03T23:53:29.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29332024-09-03T23:53:29.250ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 12 reason = Timeout
29342024-09-03T23:53:29.250ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29352024-09-03T23:53:29.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29362024-09-03T23:53:29.251ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29372024-09-03T23:53:29.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29382024-09-03T23:53:29.253ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.186638ms iteration = 12 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
29392024-09-03T23:53:29.376ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29402024-09-03T23:53:29.378ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
29412024-09-03T23:53:29.378ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29422024-09-03T23:53:29.378ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29432024-09-03T23:53:29.381ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29442024-09-03T23:53:29.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29452024-09-03T23:53:29.382ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29462024-09-03T23:53:29.385ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b1196b3e-aa3c-4486-a0ad-52f372819a8f, lookup_type: ById(b1196b3e-aa3c-4486-a0ad-52f372819a8f) } result = Ok(())
29472024-09-03T23:53:29.385ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29482024-09-03T23:53:29.385ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29492024-09-03T23:53:29.392ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b1196b3e-aa3c-4486-a0ad-52f372819a8f original_time_created = 2024-09-03 23:51:19.204380 UTC target_id = b1196b3e-aa3c-4486-a0ad-52f372819a8f time_created = 2024-09-03 23:51:19.204380 UTC
29502024-09-03T23:53:29.392ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 148.138831ms iteration = 12 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b1196b3e-aa3c-4486-a0ad-52f372819a8f","time_created":"2024-09-03T23:51:19.204380Z"}
29512024-09-03T23:53:29.734ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = f9366a05-c02b-4153-9478-504a8c58ebcc roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
29522024-09-03T23:53:29.734ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = f9366a05-c02b-4153-9478-504a8c58ebcc resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
29532024-09-03T23:53:29.736ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2145 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = f9366a05-c02b-4153-9478-504a8c58ebcc response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
29542024-09-03T23:53:29.802ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 747 local_addr = [fd00:1122:3344:101::c]:59395 method = GET remote_addr = [fd00:1122:3344:101::d]:55949 req_id = cbb0b5db-3ca1-450f-9138-c9042115368c response_code = 200 uri = /5f5ce676-2064-4d97-b873-fbcbc29495de
29552024-09-03T23:53:30.755ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = e398a3c3-37ff-4dda-b919-ba84f208dbd4 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
29562024-09-03T23:53:30.755ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = e398a3c3-37ff-4dda-b919-ba84f208dbd4 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
29572024-09-03T23:53:30.757ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2073 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = e398a3c3-37ff-4dda-b919-ba84f208dbd4 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
29582024-09-03T23:53:31.776ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 444f9239-eccf-4c3f-845d-a5023e4e7e2c roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
29592024-09-03T23:53:31.776ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 444f9239-eccf-4c3f-845d-a5023e4e7e2c resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
29602024-09-03T23:53:31.778ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1796 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 444f9239-eccf-4c3f-845d-a5023e4e7e2c response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
29612024-09-03T23:53:32.797ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 82cae781-08aa-4abb-a992-74ad5eef0739 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
29622024-09-03T23:53:32.798ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 82cae781-08aa-4abb-a992-74ad5eef0739 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
29632024-09-03T23:53:32.800ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2601 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 82cae781-08aa-4abb-a992-74ad5eef0739 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
29642024-09-03T23:53:33.819ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 81198323-35a4-4b17-8802-4cefde2a67a4 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
29652024-09-03T23:53:33.819ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 81198323-35a4-4b17-8802-4cefde2a67a4 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
29662024-09-03T23:53:33.820ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1674 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 81198323-35a4-4b17-8802-4cefde2a67a4 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
29672024-09-03T23:53:34.841ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 8d712074-e7be-4de3-aac7-ad45875cda0e roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
29682024-09-03T23:53:34.842ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 8d712074-e7be-4de3-aac7-ad45875cda0e resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
29692024-09-03T23:53:34.844ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3140 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 8d712074-e7be-4de3-aac7-ad45875cda0e response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
29702024-09-03T23:53:35.864ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 72dd1665-be64-47ea-a4b8-85ce8a2f70d9 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
29712024-09-03T23:53:35.864ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 72dd1665-be64-47ea-a4b8-85ce8a2f70d9 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
29722024-09-03T23:53:35.866ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2054 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 72dd1665-be64-47ea-a4b8-85ce8a2f70d9 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
29732024-09-03T23:53:36.885ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = c5458738-2b75-48b8-a5d3-9b630ef304bd roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
29742024-09-03T23:53:36.885ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = c5458738-2b75-48b8-a5d3-9b630ef304bd resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
29752024-09-03T23:53:36.887ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2588 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = c5458738-2b75-48b8-a5d3-9b630ef304bd response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
29762024-09-03T23:53:37.907ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = a8f5e2fc-0d40-456a-a7be-a566576f18bf roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
29772024-09-03T23:53:37.907ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = a8f5e2fc-0d40-456a-a7be-a566576f18bf resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
29782024-09-03T23:53:37.909ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2074 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = a8f5e2fc-0d40-456a-a7be-a566576f18bf response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
29792024-09-03T23:53:38.932ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 5e1086fe-0f89-4396-9602-49f157ebc57b roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
29802024-09-03T23:53:38.932ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 5e1086fe-0f89-4396-9602-49f157ebc57b resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
29812024-09-03T23:53:38.933ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1594 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 5e1086fe-0f89-4396-9602-49f157ebc57b response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
29822024-09-03T23:53:39.243ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 3 reason = Timeout
29832024-09-03T23:53:39.243ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 13 reason = Timeout
29842024-09-03T23:53:39.243ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
29852024-09-03T23:53:39.243ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
29862024-09-03T23:53:39.243ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 3 reason = Timeout
29872024-09-03T23:53:39.243ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29882024-09-03T23:53:39.243ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 5 reason = Timeout
29892024-09-03T23:53:39.243ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 3 reason = Timeout
29902024-09-03T23:53:39.243ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 5 reason = Timeout
29912024-09-03T23:53:39.243ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 4 reason = Timeout
29922024-09-03T23:53:39.243ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 3 reason = Timeout
29932024-09-03T23:53:39.243ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = b1196b3e-aa3c-4486-a0ad-52f372819a8f
29942024-09-03T23:53:39.243ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 3 reason = Timeout
29952024-09-03T23:53:39.243ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
29962024-09-03T23:53:39.243ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 8.39\u{b5}s iteration = 4 status = {"enabled":false,"target_id":"b1196b3e-aa3c-4486-a0ad-52f372819a8f"}
29972024-09-03T23:53:39.243ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
29982024-09-03T23:53:39.243ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
29992024-09-03T23:53:39.243ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 5 reason = Timeout
30002024-09-03T23:53:39.243ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
30012024-09-03T23:53:39.243ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 3 reason = Timeout
30022024-09-03T23:53:39.243ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 5 reason = Timeout
30032024-09-03T23:53:39.243ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 5 reason = Timeout
30042024-09-03T23:53:39.243ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-09-03 23:43:39.243842867 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
30052024-09-03T23:53:39.243ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
30062024-09-03T23:53:39.243ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
30072024-09-03T23:53:39.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
30082024-09-03T23:53:39.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
30092024-09-03T23:53:39.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30102024-09-03T23:53:39.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
30112024-09-03T23:53:39.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
30122024-09-03T23:53:39.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
30132024-09-03T23:53:39.244ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1f2af9fb-1e02-483c-afd2-2b8742b46afd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("90a0c753-ce30-4bd3-a374-17c504cb8aee.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("90a0c753-ce30-4bd3-a374-17c504cb8aee.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1197, tv_nsec: 746284966 } })
30142024-09-03T23:53:39.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
30152024-09-03T23:53:39.244ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("321ab50f-2ef5-4620-bbd0-13eba6f06554.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("32795d59-c08e-49d2-b2b0-79f550835c9d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a7781486-6706-487a-a86f-e75908a89f03.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("a7781486-6706-487a-a86f-e75908a89f03.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1197, tv_nsec: 746409279 } })
30162024-09-03T23:53:39.245ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
30172024-09-03T23:53:39.245ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.636295ms iteration = 3 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
30182024-09-03T23:53:39.245ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 5 reason = Timeout
30192024-09-03T23:53:39.245ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 5 reason = Timeout
30202024-09-03T23:53:39.245ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
30212024-09-03T23:53:39.245ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 5 reason = Timeout
30222024-09-03T23:53:39.245ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30232024-09-03T23:53:39.245ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 3 reason = Timeout
30242024-09-03T23:53:39.245ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30252024-09-03T23:53:39.245ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
30262024-09-03T23:53:39.245ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
30272024-09-03T23:53:39.245ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 7 reason = Timeout
30282024-09-03T23:53:39.245ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 5 reason = Timeout
30292024-09-03T23:53:39.245ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
30302024-09-03T23:53:39.245ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30312024-09-03T23:53:39.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30322024-09-03T23:53:39.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30332024-09-03T23:53:39.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
30342024-09-03T23:53:39.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30352024-09-03T23:53:39.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
30362024-09-03T23:53:39.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
30372024-09-03T23:53:39.246ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
30382024-09-03T23:53:39.246ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 2.846941ms iteration = 3 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
30392024-09-03T23:53:39.246ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
30402024-09-03T23:53:39.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
30412024-09-03T23:53:39.247ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
30422024-09-03T23:53:39.247ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.757351ms iteration = 5 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
30432024-09-03T23:53:39.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
30442024-09-03T23:53:39.247ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30452024-09-03T23:53:39.248ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b281022b-35b2-452e-ad2b-78e12f6ca16a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b281022b-35b2-452e-ad2b-78e12f6ca16a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1197, tv_nsec: 750321744 } })
30462024-09-03T23:53:39.249ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
30472024-09-03T23:53:39.249ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 3 reason = Timeout
30482024-09-03T23:53:39.249ZINFOnexus (BackgroundTasks): Abandoned VMM reaper running background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:76
30492024-09-03T23:53:39.249ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
30502024-09-03T23:53:39.249ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 5 reason = Timeout
30512024-09-03T23:53:39.249ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
30522024-09-03T23:53:39.249ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 5 reason = Timeout
30532024-09-03T23:53:39.249ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
30542024-09-03T23:53:39.249ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 5 reason = Timeout
30552024-09-03T23:53:39.249ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30562024-09-03T23:53:39.249ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-09-03 23:43:39.243842867 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
30572024-09-03T23:53:39.249ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 5.997739ms iteration = 3 status = {"expiration":"2024-09-03T23:43:39.243842867Z","pruned":[]}
30582024-09-03T23:53:39.249ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 5 reason = Timeout
30592024-09-03T23:53:39.249ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
30602024-09-03T23:53:39.249ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 13 reason = Timeout
30612024-09-03T23:53:39.249ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 3 reason = Timeout
30622024-09-03T23:53:39.249ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30632024-09-03T23:53:39.249ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
30642024-09-03T23:53:39.249ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 5 reason = Timeout
30652024-09-03T23:53:39.249ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
30662024-09-03T23:53:39.249ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 5 reason = Timeout
30672024-09-03T23:53:39.249ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
30682024-09-03T23:53:39.249ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 5 reason = Timeout
30692024-09-03T23:53:39.250ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
30702024-09-03T23:53:39.250ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
30712024-09-03T23:53:39.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
30722024-09-03T23:53:39.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30732024-09-03T23:53:39.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
30742024-09-03T23:53:39.250ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b281022b-35b2-452e-ad2b-78e12f6ca16a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b281022b-35b2-452e-ad2b-78e12f6ca16a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1197, tv_nsec: 752196984 } })
30752024-09-03T23:53:39.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30762024-09-03T23:53:39.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
30772024-09-03T23:53:39.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
30782024-09-03T23:53:39.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
30792024-09-03T23:53:39.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
30802024-09-03T23:53:39.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
30812024-09-03T23:53:39.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
30822024-09-03T23:53:39.251ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
30832024-09-03T23:53:39.251ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
30842024-09-03T23:53:39.251ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30852024-09-03T23:53:39.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30862024-09-03T23:53:39.253ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30872024-09-03T23:53:39.254ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30882024-09-03T23:53:39.254ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30892024-09-03T23:53:39.255ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30902024-09-03T23:53:39.256ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
30912024-09-03T23:53:39.256ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30922024-09-03T23:53:39.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30932024-09-03T23:53:39.257ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
30942024-09-03T23:53:39.257ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
30952024-09-03T23:53:39.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
30962024-09-03T23:53:39.257ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
30972024-09-03T23:53:39.257ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
30982024-09-03T23:53:39.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
30992024-09-03T23:53:39.258ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
31002024-09-03T23:53:39.258ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
31012024-09-03T23:53:39.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
31022024-09-03T23:53:39.259ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31032024-09-03T23:53:39.260ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
31042024-09-03T23:53:39.260ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31052024-09-03T23:53:39.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
31062024-09-03T23:53:39.261ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31072024-09-03T23:53:39.262ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
31082024-09-03T23:53:39.262ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
31092024-09-03T23:53:39.262ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
31102024-09-03T23:53:39.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
31112024-09-03T23:53:39.263ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
31122024-09-03T23:53:39.263ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31132024-09-03T23:53:39.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31142024-09-03T23:53:39.265ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 15.126205ms iteration = 5 status = {"errors":[],"records_set_to_done":[]}
31152024-09-03T23:53:39.266ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 16.420614ms iteration = 3 status = {"errors":[],"found_port_ok":[]}
31162024-09-03T23:53:39.267ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31172024-09-03T23:53:39.267ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31182024-09-03T23:53:39.268ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
31192024-09-03T23:53:39.268ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
31202024-09-03T23:53:39.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
31212024-09-03T23:53:39.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
31222024-09-03T23:53:39.269ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
31232024-09-03T23:53:39.269ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
31242024-09-03T23:53:39.269ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 24.200011ms iteration = 3 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
31252024-09-03T23:53:39.270ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31262024-09-03T23:53:39.271ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
31272024-09-03T23:53:39.271ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31282024-09-03T23:53:39.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31292024-09-03T23:53:39.285ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31302024-09-03T23:53:39.288ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
31312024-09-03T23:53:39.288ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
31322024-09-03T23:53:39.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
31332024-09-03T23:53:39.293ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
31342024-09-03T23:53:39.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
31352024-09-03T23:53:39.293ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31362024-09-03T23:53:39.296ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31372024-09-03T23:53:39.298ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
31382024-09-03T23:53:39.299ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
31392024-09-03T23:53:39.299ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
31402024-09-03T23:53:39.299ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
31412024-09-03T23:53:39.299ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
31422024-09-03T23:53:39.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
31432024-09-03T23:53:39.300ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
31442024-09-03T23:53:39.300ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
31452024-09-03T23:53:39.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
31462024-09-03T23:53:39.306ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
31472024-09-03T23:53:39.306ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
31482024-09-03T23:53:39.306ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
31492024-09-03T23:53:39.306ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
31502024-09-03T23:53:39.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
31512024-09-03T23:53:39.307ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31522024-09-03T23:53:39.309ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
31532024-09-03T23:53:39.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
31542024-09-03T23:53:39.310ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31552024-09-03T23:53:39.310ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
31562024-09-03T23:53:39.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
31572024-09-03T23:53:39.310ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31582024-09-03T23:53:39.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31592024-09-03T23:53:39.311ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
31602024-09-03T23:53:39.311ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
31612024-09-03T23:53:39.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
31622024-09-03T23:53:39.312ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
31632024-09-03T23:53:39.312ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
31642024-09-03T23:53:39.312ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 62.433084ms iteration = 3 status = {"error":null,"error_count":0,"found":0,"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0}
31652024-09-03T23:53:39.313ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 63.148811ms iteration = 13 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
31662024-09-03T23:53:39.313ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31672024-09-03T23:53:39.314ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
31682024-09-03T23:53:39.314ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 64.435777ms iteration = 5 status = {"errors":[],"garbage_collect_requested":[]}
31692024-09-03T23:53:39.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
31702024-09-03T23:53:39.314ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
31712024-09-03T23:53:39.314ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
31722024-09-03T23:53:39.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
31732024-09-03T23:53:39.315ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 69.816384ms iteration = 5 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
31742024-09-03T23:53:39.316ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31752024-09-03T23:53:39.317ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b1196b3e-aa3c-4486-a0ad-52f372819a8f, lookup_type: ById(b1196b3e-aa3c-4486-a0ad-52f372819a8f) } result = Ok(())
31762024-09-03T23:53:39.317ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31772024-09-03T23:53:39.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31782024-09-03T23:53:39.319ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:56
31792024-09-03T23:53:39.319ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
31802024-09-03T23:53:39.319ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
31812024-09-03T23:53:39.319ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
31822024-09-03T23:53:39.319ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
31832024-09-03T23:53:39.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
31842024-09-03T23:53:39.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
31852024-09-03T23:53:39.320ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
31862024-09-03T23:53:39.320ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 3d837478-6c27-4614-b539-014b54fe9c3e dns_zone_name = oxide.test found_so_far = 0 version = 2
31872024-09-03T23:53:39.320ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
31882024-09-03T23:53:39.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
31892024-09-03T23:53:39.322ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31902024-09-03T23:53:39.322ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:56
31912024-09-03T23:53:39.322ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
31922024-09-03T23:53:39.322ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
31932024-09-03T23:53:39.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
31942024-09-03T23:53:39.326ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
31952024-09-03T23:53:39.326ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
31962024-09-03T23:53:39.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
31972024-09-03T23:53:39.327ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
31982024-09-03T23:53:39.328ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
31992024-09-03T23:53:39.328ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 3d837478-6c27-4614-b539-014b54fe9c3e dns_zone_name = oxide.test found_so_far = 1 version = 2
32002024-09-03T23:53:39.328ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
32012024-09-03T23:53:39.328ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-09-03 23:51:42.685737 UTC dns_group = external generation = 2
32022024-09-03T23:53:39.328ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 84.991301ms iteration = 3 status = {"generation":2}
32032024-09-03T23:53:39.329ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32042024-09-03T23:53:39.332ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
32052024-09-03T23:53:39.332ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
32062024-09-03T23:53:39.332ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
32072024-09-03T23:53:39.333ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32082024-09-03T23:53:39.335ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
32092024-09-03T23:53:39.335ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
32102024-09-03T23:53:39.335ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
32112024-09-03T23:53:39.350ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
32122024-09-03T23:53:39.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
32132024-09-03T23:53:39.353ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
32142024-09-03T23:53:39.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
32152024-09-03T23:53:39.355ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:56
32162024-09-03T23:53:39.355ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:241 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
32172024-09-03T23:53:39.355ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 105.3919ms iteration = 5 status = {"destroyed_active_vmms":0,"error":null,"failed_active_vmms":0,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
32182024-09-03T23:53:39.355ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 105.717557ms iteration = 5 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
32192024-09-03T23:53:39.355ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
32202024-09-03T23:53:39.355ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 35395b13-f2fe-45cc-ba7e-90fa45dea705 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
32212024-09-03T23:53:39.355ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
32222024-09-03T23:53:39.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
32232024-09-03T23:53:39.368ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:480 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
32242024-09-03T23:53:39.368ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 119.098835ms iteration = 5 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
32252024-09-03T23:53:39.369ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 123.842627ms iteration = 7 status = {"physical_disks_added":0}
32262024-09-03T23:53:39.375ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
32272024-09-03T23:53:39.376ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b281022b-35b2-452e-ad2b-78e12f6ca16a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b281022b-35b2-452e-ad2b-78e12f6ca16a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1197, tv_nsec: 878332970 } })
32282024-09-03T23:53:39.376ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df
32292024-09-03T23:53:39.380ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 130.50143ms iteration = 5 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
32302024-09-03T23:53:39.385ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
32312024-09-03T23:53:39.411ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
32322024-09-03T23:53:39.411ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
32332024-09-03T23:53:39.411ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "3033ed17-4422-48b2-a167-f15d43ff426c", "content-length": "26", "date": "Tue, 03 Sep 2024 23:53:39 GMT"} })
32342024-09-03T23:53:39.411ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
32352024-09-03T23:53:39.413ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
32362024-09-03T23:53:39.418ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
32372024-09-03T23:53:39.418ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
32382024-09-03T23:53:39.418ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "7ebb336d-8c8d-4507-bc03-f1c07a30f019", "content-length": "26", "date": "Tue, 03 Sep 2024 23:53:39 GMT"} })
32392024-09-03T23:53:39.418ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
32402024-09-03T23:53:39.420ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
32412024-09-03T23:53:39.434ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b1196b3e-aa3c-4486-a0ad-52f372819a8f original_time_created = 2024-09-03 23:51:19.204380 UTC target_id = b1196b3e-aa3c-4486-a0ad-52f372819a8f time_created = 2024-09-03 23:51:19.204380 UTC
32422024-09-03T23:53:39.434ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 190.590445ms iteration = 13 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b1196b3e-aa3c-4486-a0ad-52f372819a8f","time_created":"2024-09-03T23:51:19.204380Z"}
32432024-09-03T23:53:39.486ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32442024-09-03T23:53:39.486ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32452024-09-03T23:53:39.535ZDEBGnexus (BackgroundTasks): client request SledAgent = b281022b-35b2-452e-ad2b-78e12f6ca16a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
32462024-09-03T23:53:39.535ZDEBGnexus (BackgroundTasks): client response SledAgent = b281022b-35b2-452e-ad2b-78e12f6ca16a background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ca1fc0b9-5c63-4fcb-b281-39fc5aa04baf", "content-length": "691", "date": "Tue, 03 Sep 2024 23:53:39 GMT"} })
32472024-09-03T23:53:39.535ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
32482024-09-03T23:53:39.536ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
32492024-09-03T23:53:39.536ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
32502024-09-03T23:53:39.537ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32512024-09-03T23:53:39.537ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32522024-09-03T23:53:39.539ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 293.657544ms iteration = 5 status = {}
32532024-09-03T23:53:39.540ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
32542024-09-03T23:53:39.540ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
32552024-09-03T23:53:39.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
32562024-09-03T23:53:39.540ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
32572024-09-03T23:53:39.541ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
32582024-09-03T23:53:39.541ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
32592024-09-03T23:53:39.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
32602024-09-03T23:53:39.576ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
32612024-09-03T23:53:39.576ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d41976ee-347f-4c0e-9461-dd9e4bf4f756", "content-length": "1", "date": "Tue, 03 Sep 2024 23:53:39 GMT"} })
32622024-09-03T23:53:39.578ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
32632024-09-03T23:53:39.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
32642024-09-03T23:53:39.586ZDEBGnexus (BackgroundTasks): client request SledAgent = b281022b-35b2-452e-ad2b-78e12f6ca16a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
32652024-09-03T23:53:39.586ZDEBGnexus (BackgroundTasks): client response SledAgent = b281022b-35b2-452e-ad2b-78e12f6ca16a background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6dccc895-3de5-4d80-98c0-9c494fe2589e", "content-length": "372", "date": "Tue, 03 Sep 2024 23:53:39 GMT"} })
32662024-09-03T23:53:39.586ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32672024-09-03T23:53:39.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32682024-09-03T23:53:39.589ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32692024-09-03T23:53:39.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32702024-09-03T23:53:39.590ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 346.780218ms iteration = 5 status = null
32712024-09-03T23:53:39.591ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32722024-09-03T23:53:39.591ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 35395b13-f2fe-45cc-ba7e-90fa45dea705 dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
32732024-09-03T23:53:39.591ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
32742024-09-03T23:53:39.591ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-09-03 23:51:41.890432 UTC dns_group = internal generation = 1
32752024-09-03T23:53:39.591ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 347.720108ms iteration = 3 status = {"generation":1}
32762024-09-03T23:53:39.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32772024-09-03T23:53:39.594ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32782024-09-03T23:53:39.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32792024-09-03T23:53:39.596ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df zone_address = fd00:1122:3344:101::2
32802024-09-03T23:53:39.596ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
32812024-09-03T23:53:39.596ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f5054c39-a8a6-414f-a323-821de4b18c55", "content-length": "26", "date": "Tue, 03 Sep 2024 23:53:39 GMT"} })
32822024-09-03T23:53:39.596ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
32832024-09-03T23:53:39.598ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df
32842024-09-03T23:53:39.598ZDEBGnexus (BackgroundTasks): client request SledAgent = b281022b-35b2-452e-ad2b-78e12f6ca16a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
32852024-09-03T23:53:39.598ZDEBGnexus (BackgroundTasks): client response SledAgent = b281022b-35b2-452e-ad2b-78e12f6ca16a background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "19d9d054-e562-4b65-b0fe-a304707a8347", "date": "Tue, 03 Sep 2024 23:53:39 GMT"} })
32862024-09-03T23:53:39.599ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 350.12495ms iteration = 5 status = {}
32872024-09-03T23:53:39.601ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 357.369696ms iteration = 5 status = {}
32882024-09-03T23:53:39.603ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
32892024-09-03T23:53:39.604ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "75af0570-25f0-4702-ad4c-9493543555e9", "date": "Tue, 03 Sep 2024 23:53:39 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
32902024-09-03T23:53:39.604ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
32912024-09-03T23:53:39.605ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "57c803cc-8092-48a2-b24a-9e4ea8242f7a", "date": "Tue, 03 Sep 2024 23:53:39 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
32922024-09-03T23:53:39.605ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
32932024-09-03T23:53:39.609ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
32942024-09-03T23:53:39.609ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 365.416449ms iteration = 5 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
32952024-09-03T23:53:39.631ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-09-03T23:51:37.486746Z, time_modified: 2024-09-03T23:51:37.486746Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 8448d8a2-33e4-4746-ac02-db97b8df3ca4, db_silo: Silo { identity: SiloIdentity { id: 8448d8a2-33e4-4746-ac02-db97b8df3ca4, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-09-03T23:51:42.648012Z, time_modified: 2024-09-03T23:51:42.648012Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "294cc86510f94c68a456b8ade6786c3fe5efad002008ff9982b0149d3f4d8d7a" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 8448d8a2-33e4-4746-ac02-db97b8df3ca4, db_silo: Silo { identity: SiloIdentity { id: 8448d8a2-33e4-4746-ac02-db97b8df3ca4, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-09-03T23:51:42.648012Z, time_modified: 2024-09-03T23:51:42.648012Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "294cc86510f94c68a456b8ade6786c3fe5efad002008ff9982b0149d3f4d8d7a" }] }) }
32962024-09-03T23:53:39.631ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 387.826872ms iteration = 3 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"8448d8a2-33e4-4746-ac02-db97b8df3ca4","tls_certs":["294cc86510f94c68a456b8ade6786c3fe5efad002008ff9982b0149d3f4d8d7a"]}},"default_endpoint":{"silo_id":"8448d8a2-33e4-4746-ac02-db97b8df3ca4","tls_certs":["294cc86510f94c68a456b8ade6786c3fe5efad002008ff9982b0149d3f4d8d7a"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
32972024-09-03T23:53:39.633ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32982024-09-03T23:53:39.636ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: b281022b-35b2-452e-ad2b-78e12f6ca16a, lookup_type: ById(b281022b-35b2-452e-ad2b-78e12f6ca16a) } result = Ok(())
32992024-09-03T23:53:39.636ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
33002024-09-03T23:53:39.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
33012024-09-03T23:53:39.638ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 392.937852ms iteration = 5 status = 0
33022024-09-03T23:53:39.691ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
33032024-09-03T23:53:39.691ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "29c4a51d-3217-4574-8c31-153b8a507535", "date": "Tue, 03 Sep 2024 23:53:39 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
33042024-09-03T23:53:39.691ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
33052024-09-03T23:53:39.693ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "41a4cd5e-7016-4570-9cb9-7d116636eeec", "date": "Tue, 03 Sep 2024 23:53:39 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
33062024-09-03T23:53:39.693ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
33072024-09-03T23:53:39.694ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "23158870-ab12-4ac2-9d1c-9821a82ff638", "date": "Tue, 03 Sep 2024 23:53:39 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
33082024-09-03T23:53:39.694ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
33092024-09-03T23:53:39.696ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
33102024-09-03T23:53:39.696ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 452.594826ms iteration = 5 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
33112024-09-03T23:53:39.763ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33122024-09-03T23:53:39.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33132024-09-03T23:53:39.766ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: ec64e2ff-6fd0-4ab3-a8fa-a8a710b73297, rack_id: 1d4636f4-828e-412a-8daf-3bda355c92df, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(ccbb015a-58a4-4f0f-8a1a-5716d0b9db06) } rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df switch_location = Switch0
33142024-09-03T23:53:39.766ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33152024-09-03T23:53:39.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33162024-09-03T23:53:39.801ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 497 local_addr = [fd00:1122:3344:101::c]:59395 method = GET remote_addr = [fd00:1122:3344:101::d]:55949 req_id = 0239595e-5e50-4c1c-8221-23200a3214af response_code = 200 uri = /5f5ce676-2064-4d97-b873-fbcbc29495de
33172024-09-03T23:53:39.870ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
33182024-09-03T23:53:39.870ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "55214251-638f-411b-a515-3d59d548022b", "content-length": "121", "date": "Tue, 03 Sep 2024 23:53:39 GMT"} })
33192024-09-03T23:53:39.870ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
33202024-09-03T23:53:39.870ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = ccbb015a-58a4-4f0f-8a1a-5716d0b9db06
33212024-09-03T23:53:39.871ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
33222024-09-03T23:53:39.871ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
33232024-09-03T23:53:39.871ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df routes = {}
33242024-09-03T23:53:39.871ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df routes = {}
33252024-09-03T23:53:39.871ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df
33262024-09-03T23:53:39.871ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33272024-09-03T23:53:39.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33282024-09-03T23:53:39.873ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
33292024-09-03T23:53:39.873ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f75df2b7-95f9-4723-bd01-9c6609330e06", "content-length": "2", "date": "Tue, 03 Sep 2024 23:53:39 GMT"} })
33302024-09-03T23:53:39.873ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
33312024-09-03T23:53:39.873ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "59ef252b-34cc-4188-b965-2eba33a7fa84", "content-length": "52", "date": "Tue, 03 Sep 2024 23:53:39 GMT"} })
33322024-09-03T23:53:39.873ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df switch_location = Switch0
33332024-09-03T23:53:39.873ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
33342024-09-03T23:53:39.952ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 0adfe540-7939-45ca-a4c5-51f932750030 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
33352024-09-03T23:53:39.952ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 0adfe540-7939-45ca-a4c5-51f932750030 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
33362024-09-03T23:53:39.954ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2439 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 0adfe540-7939-45ca-a4c5-51f932750030 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
33372024-09-03T23:53:40.040ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "214151d6-0cd9-4e87-a9de-47980f577a9c", "date": "Tue, 03 Sep 2024 23:53:39 GMT"} })
33382024-09-03T23:53:40.040ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df switch = Switch0
33392024-09-03T23:53:40.040ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
33402024-09-03T23:53:40.040ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "5a9b5aaa-b7ab-4657-87f1-3f2aa1e0f7de", "content-length": "667", "date": "Tue, 03 Sep 2024 23:53:40 GMT"} })
33412024-09-03T23:53:40.040ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33422024-09-03T23:53:40.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33432024-09-03T23:53:40.044ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33442024-09-03T23:53:40.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33452024-09-03T23:53:40.048ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33462024-09-03T23:53:40.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33472024-09-03T23:53:40.051ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33482024-09-03T23:53:40.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33492024-09-03T23:53:40.058ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 812.546278ms iteration = 5 status = {}
33502024-09-03T23:53:40.427ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50060 req_id = 80f50236-70d7-49ba-b27d-b4c9f3fdae35 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
33512024-09-03T23:53:40.428ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50060 req_id = 80f50236-70d7-49ba-b27d-b4c9f3fdae35 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
33522024-09-03T23:53:40.430ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2703 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50060 req_id = 80f50236-70d7-49ba-b27d-b4c9f3fdae35 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
33532024-09-03T23:53:40.978ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 3ffc45d9-5b31-4021-b25f-66f7bca079cf roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
33542024-09-03T23:53:40.978ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 3ffc45d9-5b31-4021-b25f-66f7bca079cf resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
33552024-09-03T23:53:40.980ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2428 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 3ffc45d9-5b31-4021-b25f-66f7bca079cf response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
33562024-09-03T23:53:41.999ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = ca862e68-8c6b-4deb-a766-c3b042661914 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
33572024-09-03T23:53:41.999ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = ca862e68-8c6b-4deb-a766-c3b042661914 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
33582024-09-03T23:53:42.001ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2903 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = ca862e68-8c6b-4deb-a766-c3b042661914 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
33592024-09-03T23:53:43.020ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 1b7fba53-59cd-4a98-831e-2ab7fd87a034 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
33602024-09-03T23:53:43.020ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 1b7fba53-59cd-4a98-831e-2ab7fd87a034 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
33612024-09-03T23:53:43.022ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2027 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 1b7fba53-59cd-4a98-831e-2ab7fd87a034 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
33622024-09-03T23:53:44.041ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 029f632e-51e4-4725-80e7-671c5a497328 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
33632024-09-03T23:53:44.041ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 029f632e-51e4-4725-80e7-671c5a497328 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
33642024-09-03T23:53:44.043ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2173 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 029f632e-51e4-4725-80e7-671c5a497328 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
33652024-09-03T23:53:45.063ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 7263f157-9361-4041-8465-175cda380d6e roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
33662024-09-03T23:53:45.063ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 7263f157-9361-4041-8465-175cda380d6e resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
33672024-09-03T23:53:45.065ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3138 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 7263f157-9361-4041-8465-175cda380d6e response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
33682024-09-03T23:53:46.084ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = fcd561e0-a385-4c55-90dc-ae9a422fb0f8 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
33692024-09-03T23:53:46.084ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = fcd561e0-a385-4c55-90dc-ae9a422fb0f8 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
33702024-09-03T23:53:46.086ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2362 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = fcd561e0-a385-4c55-90dc-ae9a422fb0f8 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
33712024-09-03T23:53:47.106ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 53aa2668-4062-43c3-92a7-8029d431c08e roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
33722024-09-03T23:53:47.106ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 53aa2668-4062-43c3-92a7-8029d431c08e resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
33732024-09-03T23:53:47.108ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2440 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 53aa2668-4062-43c3-92a7-8029d431c08e response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
33742024-09-03T23:53:48.129ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 50e1ef33-3f2e-4686-95ae-f2d62764b561 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
33752024-09-03T23:53:48.130ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 50e1ef33-3f2e-4686-95ae-f2d62764b561 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
33762024-09-03T23:53:48.131ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2019 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 50e1ef33-3f2e-4686-95ae-f2d62764b561 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
33772024-09-03T23:53:49.150ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 9dc6ee82-e902-4b82-99e1-1274eb7ae419 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
33782024-09-03T23:53:49.150ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 9dc6ee82-e902-4b82-99e1-1274eb7ae419 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
33792024-09-03T23:53:49.153ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3324 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 9dc6ee82-e902-4b82-99e1-1274eb7ae419 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
33802024-09-03T23:53:49.243ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 14 reason = Timeout
33812024-09-03T23:53:49.243ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33822024-09-03T23:53:49.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33832024-09-03T23:53:49.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33842024-09-03T23:53:49.248ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
33852024-09-03T23:53:49.248ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33862024-09-03T23:53:49.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33872024-09-03T23:53:49.250ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 14 reason = Timeout
33882024-09-03T23:53:49.250ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
33892024-09-03T23:53:49.250ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33902024-09-03T23:53:49.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
33912024-09-03T23:53:49.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33922024-09-03T23:53:49.252ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33932024-09-03T23:53:49.254ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b1196b3e-aa3c-4486-a0ad-52f372819a8f, lookup_type: ById(b1196b3e-aa3c-4486-a0ad-52f372819a8f) } result = Ok(())
33942024-09-03T23:53:49.254ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33952024-09-03T23:53:49.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33962024-09-03T23:53:49.262ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b1196b3e-aa3c-4486-a0ad-52f372819a8f original_time_created = 2024-09-03 23:51:19.204380 UTC target_id = b1196b3e-aa3c-4486-a0ad-52f372819a8f time_created = 2024-09-03 23:51:19.204380 UTC
33972024-09-03T23:53:49.262ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.04736ms iteration = 14 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b1196b3e-aa3c-4486-a0ad-52f372819a8f","time_created":"2024-09-03T23:51:19.204380Z"}
33982024-09-03T23:53:49.277ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
33992024-09-03T23:53:49.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34002024-09-03T23:53:49.279ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.156288ms iteration = 14 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
34012024-09-03T23:53:49.802ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 593 local_addr = [fd00:1122:3344:101::c]:59395 method = GET remote_addr = [fd00:1122:3344:101::d]:55949 req_id = ac60de20-6148-46e8-bf1f-ee1ef3f5ee61 response_code = 200 uri = /5f5ce676-2064-4d97-b873-fbcbc29495de
34022024-09-03T23:53:50.171ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 1c4813ad-a284-4d2a-9e6a-cf7255aca37a roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
34032024-09-03T23:53:50.172ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 1c4813ad-a284-4d2a-9e6a-cf7255aca37a resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
34042024-09-03T23:53:50.173ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2357 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 1c4813ad-a284-4d2a-9e6a-cf7255aca37a response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
34052024-09-03T23:53:51.194ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = a38b65a9-b71d-49de-9402-dac5840d4d01 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
34062024-09-03T23:53:51.194ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = a38b65a9-b71d-49de-9402-dac5840d4d01 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
34072024-09-03T23:53:51.196ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2294 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = a38b65a9-b71d-49de-9402-dac5840d4d01 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
34082024-09-03T23:53:52.216ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 0e52790b-75d5-4f59-9217-22263526ee22 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
34092024-09-03T23:53:52.216ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 0e52790b-75d5-4f59-9217-22263526ee22 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
34102024-09-03T23:53:52.217ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1698 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 0e52790b-75d5-4f59-9217-22263526ee22 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
34112024-09-03T23:53:53.236ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = ba14c2ae-8ff0-4f05-bed5-f6cc75a2a255 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
34122024-09-03T23:53:53.236ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = ba14c2ae-8ff0-4f05-bed5-f6cc75a2a255 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
34132024-09-03T23:53:53.238ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2221 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = ba14c2ae-8ff0-4f05-bed5-f6cc75a2a255 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
34142024-09-03T23:53:54.258ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 307e5332-f7c2-4796-8f70-d40e38c2f697 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
34152024-09-03T23:53:54.258ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 307e5332-f7c2-4796-8f70-d40e38c2f697 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
34162024-09-03T23:53:54.260ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2091 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 307e5332-f7c2-4796-8f70-d40e38c2f697 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
34172024-09-03T23:53:55.280ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 03327929-de00-435c-aa4b-ded9e401156c roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
34182024-09-03T23:53:55.280ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 03327929-de00-435c-aa4b-ded9e401156c resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
34192024-09-03T23:53:55.282ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2177 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 03327929-de00-435c-aa4b-ded9e401156c response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
34202024-09-03T23:53:56.302ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 5f0eaa0b-f46f-4996-893d-7105507a20cc roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
34212024-09-03T23:53:56.302ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 5f0eaa0b-f46f-4996-893d-7105507a20cc resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
34222024-09-03T23:53:56.304ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1875 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 5f0eaa0b-f46f-4996-893d-7105507a20cc response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
34232024-09-03T23:53:57.324ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = b8442079-8b95-4724-af83-58916dd4d920 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
34242024-09-03T23:53:57.325ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = b8442079-8b95-4724-af83-58916dd4d920 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
34252024-09-03T23:53:57.326ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1682 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = b8442079-8b95-4724-af83-58916dd4d920 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
34262024-09-03T23:53:58.346ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 05a0e4a8-b14e-447a-821e-37f812aa45bd roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
34272024-09-03T23:53:58.346ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 05a0e4a8-b14e-447a-821e-37f812aa45bd resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
34282024-09-03T23:53:58.348ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2917 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 05a0e4a8-b14e-447a-821e-37f812aa45bd response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
34292024-09-03T23:53:59.244ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 15 reason = Timeout
34302024-09-03T23:53:59.244ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34312024-09-03T23:53:59.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34322024-09-03T23:53:59.246ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34332024-09-03T23:53:59.248ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
34342024-09-03T23:53:59.249ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34352024-09-03T23:53:59.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34362024-09-03T23:53:59.250ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 15 reason = Timeout
34372024-09-03T23:53:59.250ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34382024-09-03T23:53:59.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34392024-09-03T23:53:59.250ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34402024-09-03T23:53:59.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34412024-09-03T23:53:59.251ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34422024-09-03T23:53:59.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34432024-09-03T23:53:59.252ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34442024-09-03T23:53:59.254ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b1196b3e-aa3c-4486-a0ad-52f372819a8f, lookup_type: ById(b1196b3e-aa3c-4486-a0ad-52f372819a8f) } result = Ok(())
34452024-09-03T23:53:59.254ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34462024-09-03T23:53:59.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34472024-09-03T23:53:59.262ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b1196b3e-aa3c-4486-a0ad-52f372819a8f original_time_created = 2024-09-03 23:51:19.204380 UTC target_id = b1196b3e-aa3c-4486-a0ad-52f372819a8f time_created = 2024-09-03 23:51:19.204380 UTC
34482024-09-03T23:53:59.262ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.338265ms iteration = 15 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b1196b3e-aa3c-4486-a0ad-52f372819a8f","time_created":"2024-09-03T23:51:19.204380Z"}
34492024-09-03T23:53:59.278ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 28.257359ms iteration = 15 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
34502024-09-03T23:53:59.367ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = db9ea843-146a-46aa-af94-d87f33920a4d roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
34512024-09-03T23:53:59.367ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = db9ea843-146a-46aa-af94-d87f33920a4d resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
34522024-09-03T23:53:59.368ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1574 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = db9ea843-146a-46aa-af94-d87f33920a4d response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
34532024-09-03T23:53:59.801ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 442 local_addr = [fd00:1122:3344:101::c]:59395 method = GET remote_addr = [fd00:1122:3344:101::d]:55949 req_id = 73042eee-becc-4a1b-ba58-87d2446b22ca response_code = 200 uri = /5f5ce676-2064-4d97-b873-fbcbc29495de
34542024-09-03T23:54:00.389ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 544d4b02-8aad-4c8a-9be1-828cb5546639 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
34552024-09-03T23:54:00.389ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 544d4b02-8aad-4c8a-9be1-828cb5546639 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
34562024-09-03T23:54:00.391ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2057 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 544d4b02-8aad-4c8a-9be1-828cb5546639 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
34572024-09-03T23:54:01.409ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 6d572572-cecf-4466-b81e-18d9ddfe4ecc roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
34582024-09-03T23:54:01.410ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 6d572572-cecf-4466-b81e-18d9ddfe4ecc resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
34592024-09-03T23:54:01.411ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1735 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 6d572572-cecf-4466-b81e-18d9ddfe4ecc response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
34602024-09-03T23:54:02.430ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 9c7e6893-372f-44a9-94e6-60b7634d7094 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
34612024-09-03T23:54:02.430ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 9c7e6893-372f-44a9-94e6-60b7634d7094 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
34622024-09-03T23:54:02.432ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1881 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 9c7e6893-372f-44a9-94e6-60b7634d7094 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
34632024-09-03T23:54:03.451ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = aef3223b-1f62-4cf3-8a3a-6c8b9b69ea4a roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
34642024-09-03T23:54:03.451ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = aef3223b-1f62-4cf3-8a3a-6c8b9b69ea4a resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
34652024-09-03T23:54:03.453ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2209 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = aef3223b-1f62-4cf3-8a3a-6c8b9b69ea4a response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
34662024-09-03T23:54:04.472ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 4dc28b1c-a9ab-411c-858d-004eb289b559 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
34672024-09-03T23:54:04.473ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 4dc28b1c-a9ab-411c-858d-004eb289b559 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
34682024-09-03T23:54:04.475ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2182 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 4dc28b1c-a9ab-411c-858d-004eb289b559 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
34692024-09-03T23:54:05.493ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 5cf21f2e-bde5-40a7-88ad-3d84972f72cc roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
34702024-09-03T23:54:05.493ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 5cf21f2e-bde5-40a7-88ad-3d84972f72cc resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
34712024-09-03T23:54:05.495ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2401 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 5cf21f2e-bde5-40a7-88ad-3d84972f72cc response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
34722024-09-03T23:54:06.516ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = db700b5b-0265-4baf-abe0-9a8f72256fcc roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
34732024-09-03T23:54:06.516ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = db700b5b-0265-4baf-abe0-9a8f72256fcc resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
34742024-09-03T23:54:06.517ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1914 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = db700b5b-0265-4baf-abe0-9a8f72256fcc response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
34752024-09-03T23:54:07.538ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 3be34355-462a-4fbd-9ceb-98904a3884ed roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
34762024-09-03T23:54:07.539ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 3be34355-462a-4fbd-9ceb-98904a3884ed resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
34772024-09-03T23:54:07.541ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2933 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 3be34355-462a-4fbd-9ceb-98904a3884ed response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
34782024-09-03T23:54:08.560ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 23182139-0040-4eba-8586-4cbb65cae392 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
34792024-09-03T23:54:08.561ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 23182139-0040-4eba-8586-4cbb65cae392 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
34802024-09-03T23:54:08.562ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2467 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 23182139-0040-4eba-8586-4cbb65cae392 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
34812024-09-03T23:54:09.243ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 6 reason = Timeout
34822024-09-03T23:54:09.243ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 16 reason = Timeout
34832024-09-03T23:54:09.243ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 6 reason = Timeout
34842024-09-03T23:54:09.243ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 6 reason = Timeout
34852024-09-03T23:54:09.243ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
34862024-09-03T23:54:09.243ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
34872024-09-03T23:54:09.243ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34882024-09-03T23:54:09.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
34892024-09-03T23:54:09.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34902024-09-03T23:54:09.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
34912024-09-03T23:54:09.246ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 6 reason = Timeout
34922024-09-03T23:54:09.246ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 8 reason = Timeout
34932024-09-03T23:54:09.246ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 6 reason = Timeout
34942024-09-03T23:54:09.246ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
34952024-09-03T23:54:09.246ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34962024-09-03T23:54:09.246ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
34972024-09-03T23:54:09.246ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 6 reason = Timeout
34982024-09-03T23:54:09.246ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34992024-09-03T23:54:09.246ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 6 reason = Timeout
35002024-09-03T23:54:09.246ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
35012024-09-03T23:54:09.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
35022024-09-03T23:54:09.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35032024-09-03T23:54:09.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35042024-09-03T23:54:09.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35052024-09-03T23:54:09.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
35062024-09-03T23:54:09.246ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35072024-09-03T23:54:09.246ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b281022b-35b2-452e-ad2b-78e12f6ca16a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b281022b-35b2-452e-ad2b-78e12f6ca16a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1227, tv_nsec: 748754870 } })
35082024-09-03T23:54:09.247ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
35092024-09-03T23:54:09.248ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b281022b-35b2-452e-ad2b-78e12f6ca16a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b281022b-35b2-452e-ad2b-78e12f6ca16a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1227, tv_nsec: 750249412 } })
35102024-09-03T23:54:09.248ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35112024-09-03T23:54:09.248ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
35122024-09-03T23:54:09.250ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
35132024-09-03T23:54:09.250ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35142024-09-03T23:54:09.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35152024-09-03T23:54:09.250ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 6 reason = Timeout
35162024-09-03T23:54:09.250ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
35172024-09-03T23:54:09.250ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 6 reason = Timeout
35182024-09-03T23:54:09.250ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
35192024-09-03T23:54:09.250ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
35202024-09-03T23:54:09.250ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 6 reason = Timeout
35212024-09-03T23:54:09.250ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35222024-09-03T23:54:09.250ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 6 reason = Timeout
35232024-09-03T23:54:09.250ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 6 reason = Timeout
35242024-09-03T23:54:09.250ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
35252024-09-03T23:54:09.250ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
35262024-09-03T23:54:09.250ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 16 reason = Timeout
35272024-09-03T23:54:09.250ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
35282024-09-03T23:54:09.250ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 6 reason = Timeout
35292024-09-03T23:54:09.250ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
35302024-09-03T23:54:09.250ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 6 reason = Timeout
35312024-09-03T23:54:09.250ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
35322024-09-03T23:54:09.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
35332024-09-03T23:54:09.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
35342024-09-03T23:54:09.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35352024-09-03T23:54:09.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
35362024-09-03T23:54:09.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
35372024-09-03T23:54:09.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
35382024-09-03T23:54:09.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
35392024-09-03T23:54:09.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
35402024-09-03T23:54:09.252ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
35412024-09-03T23:54:09.252ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
35422024-09-03T23:54:09.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
35432024-09-03T23:54:09.255ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35442024-09-03T23:54:09.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35452024-09-03T23:54:09.262ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35462024-09-03T23:54:09.263ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35472024-09-03T23:54:09.265ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
35482024-09-03T23:54:09.265ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35492024-09-03T23:54:09.265ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
35502024-09-03T23:54:09.265ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
35512024-09-03T23:54:09.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35522024-09-03T23:54:09.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
35532024-09-03T23:54:09.267ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35542024-09-03T23:54:09.271ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b1196b3e-aa3c-4486-a0ad-52f372819a8f, lookup_type: ById(b1196b3e-aa3c-4486-a0ad-52f372819a8f) } result = Ok(())
35552024-09-03T23:54:09.271ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35562024-09-03T23:54:09.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35572024-09-03T23:54:09.274ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
35582024-09-03T23:54:09.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
35592024-09-03T23:54:09.296ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 45.652543ms iteration = 6 status = {"errors":[],"records_set_to_done":[]}
35602024-09-03T23:54:09.300ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b1196b3e-aa3c-4486-a0ad-52f372819a8f original_time_created = 2024-09-03 23:51:19.204380 UTC target_id = b1196b3e-aa3c-4486-a0ad-52f372819a8f time_created = 2024-09-03 23:51:19.204380 UTC
35612024-09-03T23:54:09.300ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35622024-09-03T23:54:09.300ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 56.504106ms iteration = 16 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b1196b3e-aa3c-4486-a0ad-52f372819a8f","time_created":"2024-09-03T23:51:19.204380Z"}
35632024-09-03T23:54:09.303ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
35642024-09-03T23:54:09.303ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35652024-09-03T23:54:09.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35662024-09-03T23:54:09.307ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
35672024-09-03T23:54:09.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
35682024-09-03T23:54:09.308ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b281022b-35b2-452e-ad2b-78e12f6ca16a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b281022b-35b2-452e-ad2b-78e12f6ca16a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1227, tv_nsec: 810357586 } })
35692024-09-03T23:54:09.308ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df
35702024-09-03T23:54:09.309ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:56
35712024-09-03T23:54:09.309ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
35722024-09-03T23:54:09.309ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
35732024-09-03T23:54:09.309ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
35742024-09-03T23:54:09.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
35752024-09-03T23:54:09.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
35762024-09-03T23:54:09.309ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 63.810954ms iteration = 6 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
35772024-09-03T23:54:09.312ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35782024-09-03T23:54:09.312ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 61.906113ms iteration = 6 status = {"errors":[],"garbage_collect_requested":[]}
35792024-09-03T23:54:09.312ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
35802024-09-03T23:54:09.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
35812024-09-03T23:54:09.314ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
35822024-09-03T23:54:09.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
35832024-09-03T23:54:09.315ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
35842024-09-03T23:54:09.315ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35852024-09-03T23:54:09.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35862024-09-03T23:54:09.317ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35872024-09-03T23:54:09.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35882024-09-03T23:54:09.319ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
35892024-09-03T23:54:09.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
35902024-09-03T23:54:09.320ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35912024-09-03T23:54:09.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35922024-09-03T23:54:09.322ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35932024-09-03T23:54:09.324ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35942024-09-03T23:54:09.326ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
35952024-09-03T23:54:09.326ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35962024-09-03T23:54:09.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35972024-09-03T23:54:09.326ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
35982024-09-03T23:54:09.327ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
35992024-09-03T23:54:09.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
36002024-09-03T23:54:09.329ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
36012024-09-03T23:54:09.329ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
36022024-09-03T23:54:09.329ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "7eef5a3a-739d-40bb-b219-4eb5d5d5035d", "content-length": "26", "date": "Tue, 03 Sep 2024 23:54:09 GMT"} })
36032024-09-03T23:54:09.329ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
36042024-09-03T23:54:09.331ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
36052024-09-03T23:54:09.331ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
36062024-09-03T23:54:09.331ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
36072024-09-03T23:54:09.332ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6ea61bba-890d-4605-905e-817d5dccf655", "content-length": "26", "date": "Tue, 03 Sep 2024 23:54:09 GMT"} })
36082024-09-03T23:54:09.332ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
36092024-09-03T23:54:09.334ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
36102024-09-03T23:54:09.344ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:56
36112024-09-03T23:54:09.344ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
36122024-09-03T23:54:09.344ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
36132024-09-03T23:54:09.344ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
36142024-09-03T23:54:09.347ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 96.290984ms iteration = 16 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
36152024-09-03T23:54:09.353ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 102.497667ms iteration = 6 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
36162024-09-03T23:54:09.358ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 114.888034ms iteration = 6 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
36172024-09-03T23:54:09.363ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 112.314119ms iteration = 6 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
36182024-09-03T23:54:09.378ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:56
36192024-09-03T23:54:09.378ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:241 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
36202024-09-03T23:54:09.378ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 128.13348ms iteration = 6 status = {"destroyed_active_vmms":0,"error":null,"failed_active_vmms":0,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
36212024-09-03T23:54:09.385ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df zone_address = fd00:1122:3344:101::2
36222024-09-03T23:54:09.385ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
36232024-09-03T23:54:09.385ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f1a473a1-0fc3-44e3-b9ba-3196d2b1f69c", "content-length": "26", "date": "Tue, 03 Sep 2024 23:54:09 GMT"} })
36242024-09-03T23:54:09.385ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
36252024-09-03T23:54:09.387ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df
36262024-09-03T23:54:09.388ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:480 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
36272024-09-03T23:54:09.388ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 137.782557ms iteration = 6 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
36282024-09-03T23:54:09.417ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36292024-09-03T23:54:09.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36302024-09-03T23:54:09.426ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 180.800094ms iteration = 8 status = {"physical_disks_added":0}
36312024-09-03T23:54:09.444ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36322024-09-03T23:54:09.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36332024-09-03T23:54:09.486ZDEBGnexus (BackgroundTasks): client request SledAgent = b281022b-35b2-452e-ad2b-78e12f6ca16a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
36342024-09-03T23:54:09.486ZDEBGnexus (BackgroundTasks): client response SledAgent = b281022b-35b2-452e-ad2b-78e12f6ca16a background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "21485db5-c791-4b9f-8014-035f2be8ffa9", "content-length": "372", "date": "Tue, 03 Sep 2024 23:54:09 GMT"} })
36352024-09-03T23:54:09.486ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36362024-09-03T23:54:09.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36372024-09-03T23:54:09.488ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36382024-09-03T23:54:09.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36392024-09-03T23:54:09.489ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36402024-09-03T23:54:09.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36412024-09-03T23:54:09.490ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36422024-09-03T23:54:09.492ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36432024-09-03T23:54:09.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36442024-09-03T23:54:09.493ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: b281022b-35b2-452e-ad2b-78e12f6ca16a, lookup_type: ById(b281022b-35b2-452e-ad2b-78e12f6ca16a) } result = Ok(())
36452024-09-03T23:54:09.493ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36462024-09-03T23:54:09.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36472024-09-03T23:54:09.495ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 249.31734ms iteration = 6 status = 0
36482024-09-03T23:54:09.495ZDEBGnexus (BackgroundTasks): client request SledAgent = b281022b-35b2-452e-ad2b-78e12f6ca16a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
36492024-09-03T23:54:09.496ZDEBGnexus (BackgroundTasks): client response SledAgent = b281022b-35b2-452e-ad2b-78e12f6ca16a background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "7976ef93-10cf-46ca-adca-cb453ca2659e", "date": "Tue, 03 Sep 2024 23:54:09 GMT"} })
36502024-09-03T23:54:09.498ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 248.072533ms iteration = 6 status = {}
36512024-09-03T23:54:09.513ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36522024-09-03T23:54:09.515ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
36532024-09-03T23:54:09.515ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36542024-09-03T23:54:09.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36552024-09-03T23:54:09.537ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
36562024-09-03T23:54:09.537ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "dd6ffe00-f22f-4fed-8c51-89b6ac31f8ef", "content-length": "1", "date": "Tue, 03 Sep 2024 23:54:09 GMT"} })
36572024-09-03T23:54:09.540ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
36582024-09-03T23:54:09.540ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 296.344892ms iteration = 6 status = {}
36592024-09-03T23:54:09.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
36602024-09-03T23:54:09.541ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36612024-09-03T23:54:09.542ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 298.223552ms iteration = 6 status = null
36622024-09-03T23:54:09.542ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
36632024-09-03T23:54:09.542ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36642024-09-03T23:54:09.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36652024-09-03T23:54:09.581ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 75f6c4e3-1dd4-4203-b63b-6501a03db763 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
36662024-09-03T23:54:09.581ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 75f6c4e3-1dd4-4203-b63b-6501a03db763 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
36672024-09-03T23:54:09.584ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3027 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 75f6c4e3-1dd4-4203-b63b-6501a03db763 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
36682024-09-03T23:54:09.587ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36692024-09-03T23:54:09.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36702024-09-03T23:54:09.589ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: ec64e2ff-6fd0-4ab3-a8fa-a8a710b73297, rack_id: 1d4636f4-828e-412a-8daf-3bda355c92df, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(ccbb015a-58a4-4f0f-8a1a-5716d0b9db06) } rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df switch_location = Switch0
36712024-09-03T23:54:09.589ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36722024-09-03T23:54:09.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36732024-09-03T23:54:09.708ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
36742024-09-03T23:54:09.709ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "055e58e7-2506-45f2-8a41-0941efd0c18c", "content-length": "121", "date": "Tue, 03 Sep 2024 23:54:09 GMT"} })
36752024-09-03T23:54:09.709ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
36762024-09-03T23:54:09.709ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = ccbb015a-58a4-4f0f-8a1a-5716d0b9db06
36772024-09-03T23:54:09.709ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
36782024-09-03T23:54:09.709ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
36792024-09-03T23:54:09.709ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df routes = {}
36802024-09-03T23:54:09.709ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df routes = {}
36812024-09-03T23:54:09.709ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df
36822024-09-03T23:54:09.709ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36832024-09-03T23:54:09.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36842024-09-03T23:54:09.711ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
36852024-09-03T23:54:09.712ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a1bf1180-b1da-4dda-9e58-70f99e12a16e", "content-length": "2", "date": "Tue, 03 Sep 2024 23:54:09 GMT"} })
36862024-09-03T23:54:09.712ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
36872024-09-03T23:54:09.712ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "437673ae-da9e-4a08-afbe-08df8042d5d0", "content-length": "52", "date": "Tue, 03 Sep 2024 23:54:09 GMT"} })
36882024-09-03T23:54:09.712ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df switch_location = Switch0
36892024-09-03T23:54:09.712ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
36902024-09-03T23:54:09.734ZDEBGnexus (BackgroundTasks): client request SledAgent = b281022b-35b2-452e-ad2b-78e12f6ca16a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
36912024-09-03T23:54:09.801ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 462 local_addr = [fd00:1122:3344:101::c]:59395 method = GET remote_addr = [fd00:1122:3344:101::d]:55949 req_id = bce84f5e-2ab0-451d-9504-7bbdb0e063b1 response_code = 200 uri = /5f5ce676-2064-4d97-b873-fbcbc29495de
36922024-09-03T23:54:09.830ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "69fd05fe-5eda-45f9-aed6-099ccf26cce3", "date": "Tue, 03 Sep 2024 23:54:09 GMT"} })
36932024-09-03T23:54:09.830ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df switch = Switch0
36942024-09-03T23:54:09.830ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
36952024-09-03T23:54:09.831ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e1dd5f34-3615-4ecc-8a57-5a22b735a033", "content-length": "667", "date": "Tue, 03 Sep 2024 23:54:09 GMT"} })
36962024-09-03T23:54:09.831ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36972024-09-03T23:54:09.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36982024-09-03T23:54:09.832ZDEBGnexus (BackgroundTasks): client response SledAgent = b281022b-35b2-452e-ad2b-78e12f6ca16a background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c152b807-75b0-45f3-81be-ba2e8456889c", "content-length": "691", "date": "Tue, 03 Sep 2024 23:54:09 GMT"} })
36992024-09-03T23:54:09.832ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
37002024-09-03T23:54:09.832ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
37012024-09-03T23:54:09.832ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
37022024-09-03T23:54:09.833ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 587.327369ms iteration = 6 status = {}
37032024-09-03T23:54:09.835ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37042024-09-03T23:54:09.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37052024-09-03T23:54:09.839ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37062024-09-03T23:54:09.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37072024-09-03T23:54:09.842ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37082024-09-03T23:54:09.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37092024-09-03T23:54:09.848ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 602.808331ms iteration = 6 status = {}
37102024-09-03T23:54:10.462ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50060 req_id = 9f17c51b-e579-4905-b224-d7ffd054cdce roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
37112024-09-03T23:54:10.462ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50060 req_id = 9f17c51b-e579-4905-b224-d7ffd054cdce resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
37122024-09-03T23:54:10.465ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3037 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50060 req_id = 9f17c51b-e579-4905-b224-d7ffd054cdce response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
37132024-09-03T23:54:10.604ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 485cf2a6-cb0c-4f54-9eb5-cdb60be00f1c roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
37142024-09-03T23:54:10.605ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 485cf2a6-cb0c-4f54-9eb5-cdb60be00f1c resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
37152024-09-03T23:54:10.606ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1921 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 485cf2a6-cb0c-4f54-9eb5-cdb60be00f1c response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
37162024-09-03T23:54:11.627ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = ba2f8aea-9d72-436b-88ca-ec63a9d480e3 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
37172024-09-03T23:54:11.627ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = ba2f8aea-9d72-436b-88ca-ec63a9d480e3 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
37182024-09-03T23:54:11.628ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1833 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = ba2f8aea-9d72-436b-88ca-ec63a9d480e3 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
37192024-09-03T23:54:12.648ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = a726cbd1-5a70-47e2-ae78-86b2f34dc033 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
37202024-09-03T23:54:12.648ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = a726cbd1-5a70-47e2-ae78-86b2f34dc033 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
37212024-09-03T23:54:12.650ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2285 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = a726cbd1-5a70-47e2-ae78-86b2f34dc033 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
37222024-09-03T23:54:13.669ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 2d681711-916a-449e-b19d-e491d5f8792a roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
37232024-09-03T23:54:13.670ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 2d681711-916a-449e-b19d-e491d5f8792a resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
37242024-09-03T23:54:13.672ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2451 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 2d681711-916a-449e-b19d-e491d5f8792a response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
37252024-09-03T23:54:14.692ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = dac3f5bf-b272-4904-b824-efec7b729ec1 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
37262024-09-03T23:54:14.692ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = dac3f5bf-b272-4904-b824-efec7b729ec1 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
37272024-09-03T23:54:14.694ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2355 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = dac3f5bf-b272-4904-b824-efec7b729ec1 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
37282024-09-03T23:54:15.714ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 2f474c8e-32b0-4d98-8708-d22b36a7b9bd roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
37292024-09-03T23:54:15.714ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 2f474c8e-32b0-4d98-8708-d22b36a7b9bd resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
37302024-09-03T23:54:15.715ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1791 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 2f474c8e-32b0-4d98-8708-d22b36a7b9bd response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
37312024-09-03T23:54:16.734ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 40f5b292-c1db-49ac-8ede-05fbf39c6169 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
37322024-09-03T23:54:16.734ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 40f5b292-c1db-49ac-8ede-05fbf39c6169 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
37332024-09-03T23:54:16.736ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2053 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 40f5b292-c1db-49ac-8ede-05fbf39c6169 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
37342024-09-03T23:54:17.758ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 38d8ff29-ceee-486b-8c6a-b3d3f924b282 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
37352024-09-03T23:54:17.758ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 38d8ff29-ceee-486b-8c6a-b3d3f924b282 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
37362024-09-03T23:54:17.760ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1857 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 38d8ff29-ceee-486b-8c6a-b3d3f924b282 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
37372024-09-03T23:54:18.780ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = d0eee93b-1686-412e-a730-aa050e37be07 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
37382024-09-03T23:54:18.780ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = d0eee93b-1686-412e-a730-aa050e37be07 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
37392024-09-03T23:54:18.782ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2814 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = d0eee93b-1686-412e-a730-aa050e37be07 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
37402024-09-03T23:54:19.244ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 17 reason = Timeout
37412024-09-03T23:54:19.244ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37422024-09-03T23:54:19.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37432024-09-03T23:54:19.246ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37442024-09-03T23:54:19.248ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
37452024-09-03T23:54:19.248ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37462024-09-03T23:54:19.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37472024-09-03T23:54:19.250ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 17 reason = Timeout
37482024-09-03T23:54:19.250ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37492024-09-03T23:54:19.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37502024-09-03T23:54:19.250ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37512024-09-03T23:54:19.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37522024-09-03T23:54:19.252ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37532024-09-03T23:54:19.254ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b1196b3e-aa3c-4486-a0ad-52f372819a8f, lookup_type: ById(b1196b3e-aa3c-4486-a0ad-52f372819a8f) } result = Ok(())
37542024-09-03T23:54:19.254ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37552024-09-03T23:54:19.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37562024-09-03T23:54:19.263ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b1196b3e-aa3c-4486-a0ad-52f372819a8f original_time_created = 2024-09-03 23:51:19.204380 UTC target_id = b1196b3e-aa3c-4486-a0ad-52f372819a8f time_created = 2024-09-03 23:51:19.204380 UTC
37572024-09-03T23:54:19.263ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.849186ms iteration = 17 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b1196b3e-aa3c-4486-a0ad-52f372819a8f","time_created":"2024-09-03T23:51:19.204380Z"}
37582024-09-03T23:54:19.275ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37592024-09-03T23:54:19.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37602024-09-03T23:54:19.301ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 51.282944ms iteration = 17 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
37612024-09-03T23:54:19.801ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 479 local_addr = [fd00:1122:3344:101::c]:59395 method = GET remote_addr = [fd00:1122:3344:101::d]:55949 req_id = 12104cd1-14c3-45cb-817c-de75e75f54a3 response_code = 200 uri = /5f5ce676-2064-4d97-b873-fbcbc29495de
37622024-09-03T23:54:19.801ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 1cb61e50-7591-47ec-8e82-012f52888779 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
37632024-09-03T23:54:19.802ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 1cb61e50-7591-47ec-8e82-012f52888779 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
37642024-09-03T23:54:19.803ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1661 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 1cb61e50-7591-47ec-8e82-012f52888779 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
37652024-09-03T23:54:20.823ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 07956c4d-aaa5-4d6d-97aa-f6ac7ae0da0b roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
37662024-09-03T23:54:20.823ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 07956c4d-aaa5-4d6d-97aa-f6ac7ae0da0b resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
37672024-09-03T23:54:20.824ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1833 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 07956c4d-aaa5-4d6d-97aa-f6ac7ae0da0b response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
37682024-09-03T23:54:21.846ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 58c36f9c-afc5-4f33-a400-5277dbd3a824 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
37692024-09-03T23:54:21.846ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 58c36f9c-afc5-4f33-a400-5277dbd3a824 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
37702024-09-03T23:54:21.848ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2681 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 58c36f9c-afc5-4f33-a400-5277dbd3a824 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
37712024-09-03T23:54:22.869ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = d6626097-895e-430a-bd6b-c871ed11605d roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
37722024-09-03T23:54:22.869ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = d6626097-895e-430a-bd6b-c871ed11605d resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
37732024-09-03T23:54:22.870ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1992 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = d6626097-895e-430a-bd6b-c871ed11605d response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
37742024-09-03T23:54:23.890ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 4d0ddb29-d64f-46b8-8541-4712fbfac8e1 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
37752024-09-03T23:54:23.891ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 4d0ddb29-d64f-46b8-8541-4712fbfac8e1 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
37762024-09-03T23:54:23.892ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1689 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 4d0ddb29-d64f-46b8-8541-4712fbfac8e1 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
37772024-09-03T23:54:24.911ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = a47e11c9-d64a-48d4-be12-8d27bdc8adfc roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
37782024-09-03T23:54:24.912ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = a47e11c9-d64a-48d4-be12-8d27bdc8adfc resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
37792024-09-03T23:54:24.913ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2223 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = a47e11c9-d64a-48d4-be12-8d27bdc8adfc response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
37802024-09-03T23:54:25.933ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 2712b062-3d45-4899-a19c-4d5a277f82b6 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
37812024-09-03T23:54:25.933ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 2712b062-3d45-4899-a19c-4d5a277f82b6 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
37822024-09-03T23:54:25.935ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2352 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 2712b062-3d45-4899-a19c-4d5a277f82b6 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
37832024-09-03T23:54:26.955ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = ddd1925b-900c-4d8b-91e6-ea24ea870050 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
37842024-09-03T23:54:26.956ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = ddd1925b-900c-4d8b-91e6-ea24ea870050 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
37852024-09-03T23:54:26.957ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2494 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = ddd1925b-900c-4d8b-91e6-ea24ea870050 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
37862024-09-03T23:54:27.978ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = d29e166f-73a9-4a95-9d03-ef823917ca11 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
37872024-09-03T23:54:27.978ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = d29e166f-73a9-4a95-9d03-ef823917ca11 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
37882024-09-03T23:54:27.980ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2217 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = d29e166f-73a9-4a95-9d03-ef823917ca11 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
37892024-09-03T23:54:28.999ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 9bb05f2a-49c0-42ee-a664-58e900670db8 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
37902024-09-03T23:54:29.000ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 9bb05f2a-49c0-42ee-a664-58e900670db8 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
37912024-09-03T23:54:29.002ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2130 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 9bb05f2a-49c0-42ee-a664-58e900670db8 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
37922024-09-03T23:54:29.244ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 18 reason = Timeout
37932024-09-03T23:54:29.244ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37942024-09-03T23:54:29.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37952024-09-03T23:54:29.246ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37962024-09-03T23:54:29.248ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
37972024-09-03T23:54:29.248ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37982024-09-03T23:54:29.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37992024-09-03T23:54:29.249ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 18 reason = Timeout
38002024-09-03T23:54:29.249ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38012024-09-03T23:54:29.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38022024-09-03T23:54:29.250ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38032024-09-03T23:54:29.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38042024-09-03T23:54:29.280ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38052024-09-03T23:54:29.282ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38062024-09-03T23:54:29.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38072024-09-03T23:54:29.283ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b1196b3e-aa3c-4486-a0ad-52f372819a8f, lookup_type: ById(b1196b3e-aa3c-4486-a0ad-52f372819a8f) } result = Ok(())
38082024-09-03T23:54:29.283ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38092024-09-03T23:54:29.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38102024-09-03T23:54:29.285ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 35.076796ms iteration = 18 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
38112024-09-03T23:54:29.291ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b1196b3e-aa3c-4486-a0ad-52f372819a8f original_time_created = 2024-09-03 23:51:19.204380 UTC target_id = b1196b3e-aa3c-4486-a0ad-52f372819a8f time_created = 2024-09-03 23:51:19.204380 UTC
38122024-09-03T23:54:29.291ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 47.454342ms iteration = 18 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b1196b3e-aa3c-4486-a0ad-52f372819a8f","time_created":"2024-09-03T23:51:19.204380Z"}
38132024-09-03T23:54:29.801ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 511 local_addr = [fd00:1122:3344:101::c]:59395 method = GET remote_addr = [fd00:1122:3344:101::d]:55949 req_id = 95eb98e2-14e9-421e-b2a7-e0b6ac11362e response_code = 200 uri = /5f5ce676-2064-4d97-b873-fbcbc29495de
38142024-09-03T23:54:30.021ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = cb164762-c733-44f0-b832-9080b7a8aa87 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
38152024-09-03T23:54:30.021ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = cb164762-c733-44f0-b832-9080b7a8aa87 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
38162024-09-03T23:54:30.024ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2990 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = cb164762-c733-44f0-b832-9080b7a8aa87 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
38172024-09-03T23:54:31.043ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 6b51f638-2d8a-4143-9702-532ada9c19e6 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
38182024-09-03T23:54:31.044ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 6b51f638-2d8a-4143-9702-532ada9c19e6 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
38192024-09-03T23:54:31.045ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2012 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 6b51f638-2d8a-4143-9702-532ada9c19e6 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
38202024-09-03T23:54:32.064ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = ab2acc2f-e8bd-47c3-9db4-e0c7deb550d2 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
38212024-09-03T23:54:32.064ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = ab2acc2f-e8bd-47c3-9db4-e0c7deb550d2 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
38222024-09-03T23:54:32.066ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2258 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = ab2acc2f-e8bd-47c3-9db4-e0c7deb550d2 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
38232024-09-03T23:54:33.087ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 351aa017-851c-42d1-80b6-c4a33ec8cd65 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
38242024-09-03T23:54:33.087ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 351aa017-851c-42d1-80b6-c4a33ec8cd65 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
38252024-09-03T23:54:33.089ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2422 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 351aa017-851c-42d1-80b6-c4a33ec8cd65 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
38262024-09-03T23:54:34.108ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 80a04dbc-430a-444c-9c16-f88338a9ebdb roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
38272024-09-03T23:54:34.108ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 80a04dbc-430a-444c-9c16-f88338a9ebdb resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
38282024-09-03T23:54:34.109ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1861 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 80a04dbc-430a-444c-9c16-f88338a9ebdb response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
38292024-09-03T23:54:35.129ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = cbf49b1a-0663-42d7-bc92-8043942d1dcb roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
38302024-09-03T23:54:35.129ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = cbf49b1a-0663-42d7-bc92-8043942d1dcb resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
38312024-09-03T23:54:35.130ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1628 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = cbf49b1a-0663-42d7-bc92-8043942d1dcb response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
38322024-09-03T23:54:36.150ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 49a4a3a9-b062-45db-9c3e-ef906ef75415 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
38332024-09-03T23:54:36.151ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 49a4a3a9-b062-45db-9c3e-ef906ef75415 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
38342024-09-03T23:54:36.153ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2840 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 49a4a3a9-b062-45db-9c3e-ef906ef75415 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
38352024-09-03T23:54:37.172ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = a5edd53d-0e0a-4c9b-b74b-e3c9eedf2a98 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
38362024-09-03T23:54:37.172ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = a5edd53d-0e0a-4c9b-b74b-e3c9eedf2a98 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
38372024-09-03T23:54:37.174ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1869 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = a5edd53d-0e0a-4c9b-b74b-e3c9eedf2a98 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
38382024-09-03T23:54:38.194ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 3a6a577d-660c-4734-a070-f79c86e03de1 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
38392024-09-03T23:54:38.194ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 3a6a577d-660c-4734-a070-f79c86e03de1 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
38402024-09-03T23:54:38.196ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2337 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 3a6a577d-660c-4734-a070-f79c86e03de1 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
38412024-09-03T23:54:39.216ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = f689d882-1ed5-4626-b6b3-4a945fe8f655 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
38422024-09-03T23:54:39.216ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = f689d882-1ed5-4626-b6b3-4a945fe8f655 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
38432024-09-03T23:54:39.218ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2102 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = f689d882-1ed5-4626-b6b3-4a945fe8f655 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
38442024-09-03T23:54:39.244ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 6 reason = Timeout
38452024-09-03T23:54:39.244ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 19 reason = Timeout
38462024-09-03T23:54:39.244ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38472024-09-03T23:54:39.244ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 4 reason = Timeout
38482024-09-03T23:54:39.244ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 4 reason = Timeout
38492024-09-03T23:54:39.244ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-09-03 23:44:39.244225330 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
38502024-09-03T23:54:39.244ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
38512024-09-03T23:54:39.244ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 7 reason = Timeout
38522024-09-03T23:54:39.244ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 4 reason = Timeout
38532024-09-03T23:54:39.244ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
38542024-09-03T23:54:39.244ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 7 reason = Timeout
38552024-09-03T23:54:39.244ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 6 reason = Timeout
38562024-09-03T23:54:39.244ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 4 reason = Timeout
38572024-09-03T23:54:39.244ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 4 reason = Timeout
38582024-09-03T23:54:39.244ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
38592024-09-03T23:54:39.244ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 7 reason = Timeout
38602024-09-03T23:54:39.244ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 5 reason = Timeout
38612024-09-03T23:54:39.244ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 4 reason = Timeout
38622024-09-03T23:54:39.244ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
38632024-09-03T23:54:39.244ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
38642024-09-03T23:54:39.244ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = b1196b3e-aa3c-4486-a0ad-52f372819a8f
38652024-09-03T23:54:39.244ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
38662024-09-03T23:54:39.244ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
38672024-09-03T23:54:39.244ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
38682024-09-03T23:54:39.244ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 10.07\u{b5}s iteration = 5 status = {"enabled":false,"target_id":"b1196b3e-aa3c-4486-a0ad-52f372819a8f"}
38692024-09-03T23:54:39.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
38702024-09-03T23:54:39.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
38712024-09-03T23:54:39.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
38722024-09-03T23:54:39.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
38732024-09-03T23:54:39.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38742024-09-03T23:54:39.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
38752024-09-03T23:54:39.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
38762024-09-03T23:54:39.245ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
38772024-09-03T23:54:39.246ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 7 reason = Timeout
38782024-09-03T23:54:39.246ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 7 reason = Timeout
38792024-09-03T23:54:39.246ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38802024-09-03T23:54:39.246ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
38812024-09-03T23:54:39.246ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 7 reason = Timeout
38822024-09-03T23:54:39.246ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 9 reason = Timeout
38832024-09-03T23:54:39.246ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38842024-09-03T23:54:39.246ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
38852024-09-03T23:54:39.246ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 7 reason = Timeout
38862024-09-03T23:54:39.246ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38872024-09-03T23:54:39.246ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 3 reason = Timeout
38882024-09-03T23:54:39.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
38892024-09-03T23:54:39.246ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 4 reason = Timeout
38902024-09-03T23:54:39.246ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
38912024-09-03T23:54:39.246ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
38922024-09-03T23:54:39.246ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
38932024-09-03T23:54:39.246ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("321ab50f-2ef5-4620-bbd0-13eba6f06554.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("32795d59-c08e-49d2-b2b0-79f550835c9d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a7781486-6706-487a-a86f-e75908a89f03.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("a7781486-6706-487a-a86f-e75908a89f03.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1257, tv_nsec: 748152947 } })
38942024-09-03T23:54:39.246ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1f2af9fb-1e02-483c-afd2-2b8742b46afd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("90a0c753-ce30-4bd3-a374-17c504cb8aee.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("90a0c753-ce30-4bd3-a374-17c504cb8aee.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1257, tv_nsec: 748174007 } })
38952024-09-03T23:54:39.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
38962024-09-03T23:54:39.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
38972024-09-03T23:54:39.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
38982024-09-03T23:54:39.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38992024-09-03T23:54:39.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39002024-09-03T23:54:39.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
39012024-09-03T23:54:39.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
39022024-09-03T23:54:39.246ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
39032024-09-03T23:54:39.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
39042024-09-03T23:54:39.247ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
39052024-09-03T23:54:39.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
39062024-09-03T23:54:39.247ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
39072024-09-03T23:54:39.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
39082024-09-03T23:54:39.247ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
39092024-09-03T23:54:39.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
39102024-09-03T23:54:39.248ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.787231ms iteration = 7 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
39112024-09-03T23:54:39.248ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39122024-09-03T23:54:39.249ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
39132024-09-03T23:54:39.249ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-09-03 23:44:39.244225330 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
39142024-09-03T23:54:39.249ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 5.028448ms iteration = 4 status = {"expiration":"2024-09-03T23:44:39.244225330Z","pruned":[]}
39152024-09-03T23:54:39.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
39162024-09-03T23:54:39.249ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 7 reason = Timeout
39172024-09-03T23:54:39.249ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
39182024-09-03T23:54:39.249ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 7 reason = Timeout
39192024-09-03T23:54:39.249ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
39202024-09-03T23:54:39.249ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 7 reason = Timeout
39212024-09-03T23:54:39.249ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
39222024-09-03T23:54:39.250ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 19 reason = Timeout
39232024-09-03T23:54:39.250ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39242024-09-03T23:54:39.250ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 7 reason = Timeout
39252024-09-03T23:54:39.250ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
39262024-09-03T23:54:39.250ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 4 reason = Timeout
39272024-09-03T23:54:39.250ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
39282024-09-03T23:54:39.250ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 4 reason = Timeout
39292024-09-03T23:54:39.250ZINFOnexus (BackgroundTasks): Abandoned VMM reaper running background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:76
39302024-09-03T23:54:39.250ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
39312024-09-03T23:54:39.250ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 7 reason = Timeout
39322024-09-03T23:54:39.250ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
39332024-09-03T23:54:39.250ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 7 reason = Timeout
39342024-09-03T23:54:39.250ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39352024-09-03T23:54:39.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
39362024-09-03T23:54:39.250ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 7 reason = Timeout
39372024-09-03T23:54:39.250ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
39382024-09-03T23:54:39.250ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
39392024-09-03T23:54:39.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39402024-09-03T23:54:39.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
39412024-09-03T23:54:39.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
39422024-09-03T23:54:39.250ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
39432024-09-03T23:54:39.250ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 6.257555ms iteration = 4 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
39442024-09-03T23:54:39.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
39452024-09-03T23:54:39.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
39462024-09-03T23:54:39.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
39472024-09-03T23:54:39.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
39482024-09-03T23:54:39.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
39492024-09-03T23:54:39.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39502024-09-03T23:54:39.251ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
39512024-09-03T23:54:39.251ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
39522024-09-03T23:54:39.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
39532024-09-03T23:54:39.252ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
39542024-09-03T23:54:39.252ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 7.830239ms iteration = 4 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
39552024-09-03T23:54:39.252ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b281022b-35b2-452e-ad2b-78e12f6ca16a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b281022b-35b2-452e-ad2b-78e12f6ca16a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1257, tv_nsec: 753943841 } })
39562024-09-03T23:54:39.252ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b281022b-35b2-452e-ad2b-78e12f6ca16a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b281022b-35b2-452e-ad2b-78e12f6ca16a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1257, tv_nsec: 753971282 } })
39572024-09-03T23:54:39.254ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
39582024-09-03T23:54:39.254ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39592024-09-03T23:54:39.254ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
39602024-09-03T23:54:39.258ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
39612024-09-03T23:54:39.261ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39622024-09-03T23:54:39.261ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39632024-09-03T23:54:39.265ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
39642024-09-03T23:54:39.265ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39652024-09-03T23:54:39.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39662024-09-03T23:54:39.265ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
39672024-09-03T23:54:39.265ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
39682024-09-03T23:54:39.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
39692024-09-03T23:54:39.268ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
39702024-09-03T23:54:39.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
39712024-09-03T23:54:39.269ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39722024-09-03T23:54:39.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39732024-09-03T23:54:39.271ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 21.877422ms iteration = 7 status = {"errors":[],"garbage_collect_requested":[]}
39742024-09-03T23:54:39.272ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 22.630397ms iteration = 4 status = {"errors":[],"found_port_ok":[]}
39752024-09-03T23:54:39.273ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39762024-09-03T23:54:39.274ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39772024-09-03T23:54:39.276ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
39782024-09-03T23:54:39.277ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
39792024-09-03T23:54:39.277ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
39802024-09-03T23:54:39.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
39812024-09-03T23:54:39.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
39822024-09-03T23:54:39.278ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
39832024-09-03T23:54:39.278ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39842024-09-03T23:54:39.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39852024-09-03T23:54:39.292ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39862024-09-03T23:54:39.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39872024-09-03T23:54:39.312ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39882024-09-03T23:54:39.313ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39892024-09-03T23:54:39.314ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39902024-09-03T23:54:39.317ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
39912024-09-03T23:54:39.317ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39922024-09-03T23:54:39.317ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
39932024-09-03T23:54:39.317ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39942024-09-03T23:54:39.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39952024-09-03T23:54:39.317ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 67.729569ms iteration = 7 status = {"errors":[],"records_set_to_done":[]}
39962024-09-03T23:54:39.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39972024-09-03T23:54:39.317ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
39982024-09-03T23:54:39.317ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39992024-09-03T23:54:39.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40002024-09-03T23:54:39.318ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40012024-09-03T23:54:39.318ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40022024-09-03T23:54:39.320ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
40032024-09-03T23:54:39.320ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
40042024-09-03T23:54:39.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
40052024-09-03T23:54:39.322ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
40062024-09-03T23:54:39.322ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
40072024-09-03T23:54:39.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
40082024-09-03T23:54:39.322ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40092024-09-03T23:54:39.323ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b281022b-35b2-452e-ad2b-78e12f6ca16a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b281022b-35b2-452e-ad2b-78e12f6ca16a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1257, tv_nsec: 824796777 } })
40102024-09-03T23:54:39.323ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40112024-09-03T23:54:39.323ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df
40122024-09-03T23:54:39.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40132024-09-03T23:54:39.324ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
40142024-09-03T23:54:39.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
40152024-09-03T23:54:39.325ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
40162024-09-03T23:54:39.325ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
40172024-09-03T23:54:39.325ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
40182024-09-03T23:54:39.325ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40192024-09-03T23:54:39.325ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40202024-09-03T23:54:39.326ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
40212024-09-03T23:54:39.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
40222024-09-03T23:54:39.327ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
40232024-09-03T23:54:39.327ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
40242024-09-03T23:54:39.328ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
40252024-09-03T23:54:39.328ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40262024-09-03T23:54:39.328ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
40272024-09-03T23:54:39.328ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
40282024-09-03T23:54:39.328ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 78.308357ms iteration = 4 status = {"error":null,"error_count":0,"found":0,"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0}
40292024-09-03T23:54:39.330ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
40302024-09-03T23:54:39.330ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
40312024-09-03T23:54:39.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
40322024-09-03T23:54:39.330ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:56
40332024-09-03T23:54:39.330ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
40342024-09-03T23:54:39.330ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
40352024-09-03T23:54:39.330ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
40362024-09-03T23:54:39.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
40372024-09-03T23:54:39.332ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40382024-09-03T23:54:39.336ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
40392024-09-03T23:54:39.336ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
40402024-09-03T23:54:39.336ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
40412024-09-03T23:54:39.338ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40422024-09-03T23:54:39.339ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
40432024-09-03T23:54:39.339ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
40442024-09-03T23:54:39.339ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 89.880906ms iteration = 19 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
40452024-09-03T23:54:39.340ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
40462024-09-03T23:54:39.340ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
40472024-09-03T23:54:39.340ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40482024-09-03T23:54:39.341ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
40492024-09-03T23:54:39.341ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40502024-09-03T23:54:39.341ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40512024-09-03T23:54:39.344ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b1196b3e-aa3c-4486-a0ad-52f372819a8f, lookup_type: ById(b1196b3e-aa3c-4486-a0ad-52f372819a8f) } result = Ok(())
40522024-09-03T23:54:39.344ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40532024-09-03T23:54:39.344ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40542024-09-03T23:54:39.353ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:480 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
40552024-09-03T23:54:39.353ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 103.129861ms iteration = 7 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
40562024-09-03T23:54:39.365ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
40572024-09-03T23:54:39.369ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
40582024-09-03T23:54:39.372ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
40592024-09-03T23:54:39.372ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
40602024-09-03T23:54:39.372ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
40612024-09-03T23:54:39.372ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
40622024-09-03T23:54:39.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
40632024-09-03T23:54:39.374ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40642024-09-03T23:54:39.374ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b1196b3e-aa3c-4486-a0ad-52f372819a8f original_time_created = 2024-09-03 23:51:19.204380 UTC target_id = b1196b3e-aa3c-4486-a0ad-52f372819a8f time_created = 2024-09-03 23:51:19.204380 UTC
40652024-09-03T23:54:39.375ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 130.824187ms iteration = 19 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b1196b3e-aa3c-4486-a0ad-52f372819a8f","time_created":"2024-09-03T23:51:19.204380Z"}
40662024-09-03T23:54:39.378ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
40672024-09-03T23:54:39.378ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
40682024-09-03T23:54:39.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
40692024-09-03T23:54:39.379ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40702024-09-03T23:54:39.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40712024-09-03T23:54:39.382ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40722024-09-03T23:54:39.382ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40732024-09-03T23:54:39.382ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
40742024-09-03T23:54:39.382ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
40752024-09-03T23:54:39.384ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40762024-09-03T23:54:39.385ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
40772024-09-03T23:54:39.385ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
40782024-09-03T23:54:39.387ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "8331cc20-24e4-4fda-8776-a7dc91d60972", "content-length": "26", "date": "Tue, 03 Sep 2024 23:54:39 GMT"} })
40792024-09-03T23:54:39.387ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
40802024-09-03T23:54:39.388ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: b281022b-35b2-452e-ad2b-78e12f6ca16a, lookup_type: ById(b281022b-35b2-452e-ad2b-78e12f6ca16a) } result = Ok(())
40812024-09-03T23:54:39.388ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40822024-09-03T23:54:39.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40832024-09-03T23:54:39.388ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
40842024-09-03T23:54:39.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
40852024-09-03T23:54:39.389ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 139.413682ms iteration = 7 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
40862024-09-03T23:54:39.389ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
40872024-09-03T23:54:39.390ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 144.302267ms iteration = 7 status = 0
40882024-09-03T23:54:39.391ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
40892024-09-03T23:54:39.391ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
40902024-09-03T23:54:39.391ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 144.789008ms iteration = 4 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
40912024-09-03T23:54:39.396ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40922024-09-03T23:54:39.397ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 151.124035ms iteration = 7 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
40932024-09-03T23:54:39.397ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:56
40942024-09-03T23:54:39.397ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
40952024-09-03T23:54:39.397ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
40962024-09-03T23:54:39.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
40972024-09-03T23:54:39.398ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
40982024-09-03T23:54:39.398ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
40992024-09-03T23:54:39.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
41002024-09-03T23:54:39.409ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
41012024-09-03T23:54:39.409ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
41022024-09-03T23:54:39.409ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d921ee6d-2d2a-4356-913e-116ddeb6fc1a", "content-length": "26", "date": "Tue, 03 Sep 2024 23:54:39 GMT"} })
41032024-09-03T23:54:39.409ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
41042024-09-03T23:54:39.410ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
41052024-09-03T23:54:39.410ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 3d837478-6c27-4614-b539-014b54fe9c3e dns_zone_name = oxide.test found_so_far = 0 version = 2
41062024-09-03T23:54:39.410ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
41072024-09-03T23:54:39.411ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
41082024-09-03T23:54:39.411ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
41092024-09-03T23:54:39.412ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41102024-09-03T23:54:39.414ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 164.608325ms iteration = 7 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
41112024-09-03T23:54:39.415ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
41122024-09-03T23:54:39.415ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
41132024-09-03T23:54:39.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
41142024-09-03T23:54:39.417ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 3d837478-6c27-4614-b539-014b54fe9c3e dns_zone_name = oxide.test found_so_far = 1 version = 2
41152024-09-03T23:54:39.417ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
41162024-09-03T23:54:39.417ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-09-03 23:51:42.685737 UTC dns_group = external generation = 2
41172024-09-03T23:54:39.417ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 173.384574ms iteration = 4 status = {"generation":2}
41182024-09-03T23:54:39.417ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41192024-09-03T23:54:39.420ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
41202024-09-03T23:54:39.420ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
41212024-09-03T23:54:39.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
41222024-09-03T23:54:39.421ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
41232024-09-03T23:54:39.421ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
41242024-09-03T23:54:39.421ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
41252024-09-03T23:54:39.421ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
41262024-09-03T23:54:39.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
41272024-09-03T23:54:39.423ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41282024-09-03T23:54:39.424ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
41292024-09-03T23:54:39.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
41302024-09-03T23:54:39.425ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41312024-09-03T23:54:39.428ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
41322024-09-03T23:54:39.428ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
41332024-09-03T23:54:39.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
41342024-09-03T23:54:39.428ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
41352024-09-03T23:54:39.428ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
41362024-09-03T23:54:39.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
41372024-09-03T23:54:39.429ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41382024-09-03T23:54:39.432ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
41392024-09-03T23:54:39.432ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
41402024-09-03T23:54:39.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
41412024-09-03T23:54:39.435ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:56
41422024-09-03T23:54:39.435ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:241 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
41432024-09-03T23:54:39.435ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 185.083986ms iteration = 7 status = {"destroyed_active_vmms":0,"error":null,"failed_active_vmms":0,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
41442024-09-03T23:54:39.442ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 196.265767ms iteration = 3 status = {"nsuccess":5}
41452024-09-03T23:54:39.448ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df zone_address = fd00:1122:3344:101::2
41462024-09-03T23:54:39.448ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
41472024-09-03T23:54:39.449ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d7535175-2744-49cf-a77a-6782fe569411", "content-length": "26", "date": "Tue, 03 Sep 2024 23:54:39 GMT"} })
41482024-09-03T23:54:39.449ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
41492024-09-03T23:54:39.450ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df
41502024-09-03T23:54:39.460ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-09-03T23:51:37.486746Z, time_modified: 2024-09-03T23:51:37.486746Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 8448d8a2-33e4-4746-ac02-db97b8df3ca4, db_silo: Silo { identity: SiloIdentity { id: 8448d8a2-33e4-4746-ac02-db97b8df3ca4, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-09-03T23:51:42.648012Z, time_modified: 2024-09-03T23:51:42.648012Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "294cc86510f94c68a456b8ade6786c3fe5efad002008ff9982b0149d3f4d8d7a" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 8448d8a2-33e4-4746-ac02-db97b8df3ca4, db_silo: Silo { identity: SiloIdentity { id: 8448d8a2-33e4-4746-ac02-db97b8df3ca4, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-09-03T23:51:42.648012Z, time_modified: 2024-09-03T23:51:42.648012Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "294cc86510f94c68a456b8ade6786c3fe5efad002008ff9982b0149d3f4d8d7a" }] }) }
41512024-09-03T23:54:39.460ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 216.345339ms iteration = 4 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"8448d8a2-33e4-4746-ac02-db97b8df3ca4","tls_certs":["294cc86510f94c68a456b8ade6786c3fe5efad002008ff9982b0149d3f4d8d7a"]}},"default_endpoint":{"silo_id":"8448d8a2-33e4-4746-ac02-db97b8df3ca4","tls_certs":["294cc86510f94c68a456b8ade6786c3fe5efad002008ff9982b0149d3f4d8d7a"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
41522024-09-03T23:54:39.467ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
41532024-09-03T23:54:39.467ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 35395b13-f2fe-45cc-ba7e-90fa45dea705 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
41542024-09-03T23:54:39.467ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
41552024-09-03T23:54:39.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
41562024-09-03T23:54:39.470ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41572024-09-03T23:54:39.472ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
41582024-09-03T23:54:39.472ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
41592024-09-03T23:54:39.472ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
41602024-09-03T23:54:39.475ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 35395b13-f2fe-45cc-ba7e-90fa45dea705 dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
41612024-09-03T23:54:39.475ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
41622024-09-03T23:54:39.475ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-09-03 23:51:41.890432 UTC dns_group = internal generation = 1
41632024-09-03T23:54:39.475ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 231.410183ms iteration = 4 status = {"generation":1}
41642024-09-03T23:54:39.489ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 243.061525ms iteration = 9 status = {"physical_disks_added":0}
41652024-09-03T23:54:39.559ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
41662024-09-03T23:54:39.560ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "8d137a7d-d492-4210-8027-c2873fa7c004", "date": "Tue, 03 Sep 2024 23:54:39 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
41672024-09-03T23:54:39.560ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
41682024-09-03T23:54:39.562ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "ca1c6f70-bbef-4790-a787-533ddf919e31", "date": "Tue, 03 Sep 2024 23:54:39 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
41692024-09-03T23:54:39.562ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
41702024-09-03T23:54:39.563ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
41712024-09-03T23:54:39.563ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 319.452719ms iteration = 6 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
41722024-09-03T23:54:39.580ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 335.885523ms iteration = 7 status = {}
41732024-09-03T23:54:39.644ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
41742024-09-03T23:54:39.665ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
41752024-09-03T23:54:39.666ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "50afedf0-6068-4ea2-bee9-4a9c5e0ec8a3", "content-length": "1", "date": "Tue, 03 Sep 2024 23:54:39 GMT"} })
41762024-09-03T23:54:39.667ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
41772024-09-03T23:54:39.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
41782024-09-03T23:54:39.674ZDEBGnexus (BackgroundTasks): client request SledAgent = b281022b-35b2-452e-ad2b-78e12f6ca16a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
41792024-09-03T23:54:39.675ZDEBGnexus (BackgroundTasks): client response SledAgent = b281022b-35b2-452e-ad2b-78e12f6ca16a background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "1451079a-a4c8-4003-902b-9dde9fcf0037", "content-length": "691", "date": "Tue, 03 Sep 2024 23:54:39 GMT"} })
41802024-09-03T23:54:39.675ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
41812024-09-03T23:54:39.675ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
41822024-09-03T23:54:39.675ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
41832024-09-03T23:54:39.676ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 430.308717ms iteration = 7 status = {}
41842024-09-03T23:54:39.676ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 432.502944ms iteration = 7 status = null
41852024-09-03T23:54:39.716ZDEBGnexus (BackgroundTasks): client request SledAgent = b281022b-35b2-452e-ad2b-78e12f6ca16a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
41862024-09-03T23:54:39.716ZDEBGnexus (BackgroundTasks): client response SledAgent = b281022b-35b2-452e-ad2b-78e12f6ca16a background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "31e2469a-1c2f-4cfb-82f2-7b836dbd56c8", "content-length": "372", "date": "Tue, 03 Sep 2024 23:54:39 GMT"} })
41872024-09-03T23:54:39.716ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41882024-09-03T23:54:39.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41892024-09-03T23:54:39.719ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41902024-09-03T23:54:39.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41912024-09-03T23:54:39.722ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41922024-09-03T23:54:39.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41932024-09-03T23:54:39.725ZDEBGnexus (BackgroundTasks): client request SledAgent = b281022b-35b2-452e-ad2b-78e12f6ca16a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
41942024-09-03T23:54:39.725ZDEBGnexus (BackgroundTasks): client response SledAgent = b281022b-35b2-452e-ad2b-78e12f6ca16a background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "3a45dd6e-c562-48e2-95cb-9866ce32c7ac", "date": "Tue, 03 Sep 2024 23:54:39 GMT"} })
41952024-09-03T23:54:39.728ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 477.957483ms iteration = 7 status = {}
41962024-09-03T23:54:39.759ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
41972024-09-03T23:54:39.759ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "7c439775-72c4-4088-a0c8-e9e079bb6a27", "date": "Tue, 03 Sep 2024 23:54:39 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
41982024-09-03T23:54:39.759ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
41992024-09-03T23:54:39.762ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "adc88b9a-f1d9-4f95-8b51-b7a4832b7fc0", "date": "Tue, 03 Sep 2024 23:54:39 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
42002024-09-03T23:54:39.762ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
42012024-09-03T23:54:39.763ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "a695c3a9-f086-4247-ad2d-0e07443711ed", "date": "Tue, 03 Sep 2024 23:54:39 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
42022024-09-03T23:54:39.763ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
42032024-09-03T23:54:39.764ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
42042024-09-03T23:54:39.764ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 520.54998ms iteration = 6 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
42052024-09-03T23:54:39.801ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42062024-09-03T23:54:39.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42072024-09-03T23:54:39.802ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 506 local_addr = [fd00:1122:3344:101::c]:59395 method = GET remote_addr = [fd00:1122:3344:101::d]:55949 req_id = db45b187-eff0-45f3-bd18-014365170ca7 response_code = 200 uri = /5f5ce676-2064-4d97-b873-fbcbc29495de
42082024-09-03T23:54:39.803ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: ec64e2ff-6fd0-4ab3-a8fa-a8a710b73297, rack_id: 1d4636f4-828e-412a-8daf-3bda355c92df, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(ccbb015a-58a4-4f0f-8a1a-5716d0b9db06) } rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df switch_location = Switch0
42092024-09-03T23:54:39.803ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42102024-09-03T23:54:39.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42112024-09-03T23:54:39.813ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
42122024-09-03T23:54:39.814ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "8cbc3369-89f5-40e0-9be9-18288677cfb0", "content-length": "121", "date": "Tue, 03 Sep 2024 23:54:39 GMT"} })
42132024-09-03T23:54:39.814ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
42142024-09-03T23:54:39.814ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = ccbb015a-58a4-4f0f-8a1a-5716d0b9db06
42152024-09-03T23:54:39.814ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
42162024-09-03T23:54:39.814ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
42172024-09-03T23:54:39.814ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df routes = {}
42182024-09-03T23:54:39.814ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df routes = {}
42192024-09-03T23:54:39.814ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df
42202024-09-03T23:54:39.814ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42212024-09-03T23:54:39.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42222024-09-03T23:54:39.817ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
42232024-09-03T23:54:39.817ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "3a5ea1d5-54f7-4a0b-8373-c33945487d8c", "content-length": "2", "date": "Tue, 03 Sep 2024 23:54:39 GMT"} })
42242024-09-03T23:54:39.817ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
42252024-09-03T23:54:39.817ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "178111ef-5183-4965-a717-f306206a3caa", "content-length": "52", "date": "Tue, 03 Sep 2024 23:54:39 GMT"} })
42262024-09-03T23:54:39.817ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df switch_location = Switch0
42272024-09-03T23:54:39.817ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
42282024-09-03T23:54:39.924ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "1a1ec711-0e6f-43fc-a833-595efcee74ab", "date": "Tue, 03 Sep 2024 23:54:39 GMT"} })
42292024-09-03T23:54:39.924ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df switch = Switch0
42302024-09-03T23:54:39.924ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
42312024-09-03T23:54:39.924ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "2eb72327-2b95-4989-b45b-c4b005f3cb42", "content-length": "667", "date": "Tue, 03 Sep 2024 23:54:39 GMT"} })
42322024-09-03T23:54:39.924ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42332024-09-03T23:54:39.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42342024-09-03T23:54:39.928ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42352024-09-03T23:54:39.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42362024-09-03T23:54:39.932ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42372024-09-03T23:54:39.932ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42382024-09-03T23:54:39.934ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42392024-09-03T23:54:39.934ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42402024-09-03T23:54:39.941ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 694.958896ms iteration = 7 status = {}
42412024-09-03T23:54:40.243ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 8e0cd2da-773e-4c9e-bedf-fc6a57a55835 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
42422024-09-03T23:54:40.243ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 8e0cd2da-773e-4c9e-bedf-fc6a57a55835 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
42432024-09-03T23:54:40.245ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2240 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 8e0cd2da-773e-4c9e-bedf-fc6a57a55835 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
42442024-09-03T23:54:40.495ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50060 req_id = 83a723eb-850f-4b48-a78f-ef9b7758db39 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
42452024-09-03T23:54:40.496ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50060 req_id = 83a723eb-850f-4b48-a78f-ef9b7758db39 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
42462024-09-03T23:54:40.498ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3658 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50060 req_id = 83a723eb-850f-4b48-a78f-ef9b7758db39 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
42472024-09-03T23:54:41.265ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = c9a12d43-c1ee-43d8-9a05-39ff9b15a9ce roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
42482024-09-03T23:54:41.265ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = c9a12d43-c1ee-43d8-9a05-39ff9b15a9ce resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
42492024-09-03T23:54:41.268ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2912 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = c9a12d43-c1ee-43d8-9a05-39ff9b15a9ce response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
42502024-09-03T23:54:42.286ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 2d57e2d4-6a26-4d45-a21a-3e65e16220fc roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
42512024-09-03T23:54:42.287ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 2d57e2d4-6a26-4d45-a21a-3e65e16220fc resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
42522024-09-03T23:54:42.289ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2398 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 2d57e2d4-6a26-4d45-a21a-3e65e16220fc response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
42532024-09-03T23:54:43.307ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 7c6f3358-5223-42af-a3ea-a62389a85b66 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
42542024-09-03T23:54:43.308ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 7c6f3358-5223-42af-a3ea-a62389a85b66 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
42552024-09-03T23:54:43.309ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2084 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 7c6f3358-5223-42af-a3ea-a62389a85b66 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
42562024-09-03T23:54:44.327ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 4de9bc95-3212-4d5c-8996-cdb2d3f27fb0 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
42572024-09-03T23:54:44.328ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 4de9bc95-3212-4d5c-8996-cdb2d3f27fb0 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
42582024-09-03T23:54:44.330ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2407 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 4de9bc95-3212-4d5c-8996-cdb2d3f27fb0 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
42592024-09-03T23:54:45.349ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = d20c2ef3-894d-41c1-aefb-a4a6428c92d4 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
42602024-09-03T23:54:45.350ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = d20c2ef3-894d-41c1-aefb-a4a6428c92d4 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
42612024-09-03T23:54:45.351ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1905 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = d20c2ef3-894d-41c1-aefb-a4a6428c92d4 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
42622024-09-03T23:54:46.371ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = a1a4fc6c-f5eb-4342-b9ff-9cd64e13870a roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
42632024-09-03T23:54:46.371ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = a1a4fc6c-f5eb-4342-b9ff-9cd64e13870a resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
42642024-09-03T23:54:46.372ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2224 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = a1a4fc6c-f5eb-4342-b9ff-9cd64e13870a response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
42652024-09-03T23:54:47.393ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 63b09f06-3316-403a-b8fa-6bc9430571c4 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
42662024-09-03T23:54:47.393ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 63b09f06-3316-403a-b8fa-6bc9430571c4 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
42672024-09-03T23:54:47.395ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1711 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 63b09f06-3316-403a-b8fa-6bc9430571c4 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
42682024-09-03T23:54:48.413ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = e1c3b2ef-e7df-49f1-94b0-7a30b4f41687 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
42692024-09-03T23:54:48.414ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = e1c3b2ef-e7df-49f1-94b0-7a30b4f41687 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
42702024-09-03T23:54:48.415ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2218 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = e1c3b2ef-e7df-49f1-94b0-7a30b4f41687 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
42712024-09-03T23:54:49.244ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 20 reason = Timeout
42722024-09-03T23:54:49.244ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42732024-09-03T23:54:49.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42742024-09-03T23:54:49.246ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42752024-09-03T23:54:49.248ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
42762024-09-03T23:54:49.248ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42772024-09-03T23:54:49.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42782024-09-03T23:54:49.250ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42792024-09-03T23:54:49.250ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 20 reason = Timeout
42802024-09-03T23:54:49.250ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42812024-09-03T23:54:49.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42822024-09-03T23:54:49.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42832024-09-03T23:54:49.276ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42842024-09-03T23:54:49.277ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42852024-09-03T23:54:49.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42862024-09-03T23:54:49.278ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 28.090895ms iteration = 20 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
42872024-09-03T23:54:49.279ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b1196b3e-aa3c-4486-a0ad-52f372819a8f, lookup_type: ById(b1196b3e-aa3c-4486-a0ad-52f372819a8f) } result = Ok(())
42882024-09-03T23:54:49.279ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42892024-09-03T23:54:49.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42902024-09-03T23:54:49.287ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b1196b3e-aa3c-4486-a0ad-52f372819a8f original_time_created = 2024-09-03 23:51:19.204380 UTC target_id = b1196b3e-aa3c-4486-a0ad-52f372819a8f time_created = 2024-09-03 23:51:19.204380 UTC
42912024-09-03T23:54:49.287ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 43.120489ms iteration = 20 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b1196b3e-aa3c-4486-a0ad-52f372819a8f","time_created":"2024-09-03T23:51:19.204380Z"}
42922024-09-03T23:54:49.436ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 275762ca-2c22-4339-8f43-1a46e2191810 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
42932024-09-03T23:54:49.436ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 275762ca-2c22-4339-8f43-1a46e2191810 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
42942024-09-03T23:54:49.437ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2477 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 275762ca-2c22-4339-8f43-1a46e2191810 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
42952024-09-03T23:54:49.802ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 507 local_addr = [fd00:1122:3344:101::c]:59395 method = GET remote_addr = [fd00:1122:3344:101::d]:55949 req_id = 15384754-8819-4807-9903-3fb93a3cdaf0 response_code = 200 uri = /5f5ce676-2064-4d97-b873-fbcbc29495de
42962024-09-03T23:54:50.457ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = f1b95f81-fca2-4947-85ce-cf9473af96f0 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
42972024-09-03T23:54:50.457ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = f1b95f81-fca2-4947-85ce-cf9473af96f0 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
42982024-09-03T23:54:50.458ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1629 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = f1b95f81-fca2-4947-85ce-cf9473af96f0 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
42992024-09-03T23:54:51.479ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 107638aa-0f15-4bb0-9d64-4a66eaffff47 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
43002024-09-03T23:54:51.479ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 107638aa-0f15-4bb0-9d64-4a66eaffff47 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
43012024-09-03T23:54:51.481ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1974 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 107638aa-0f15-4bb0-9d64-4a66eaffff47 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
43022024-09-03T23:54:52.499ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = fd59f3c7-f9d9-4ed3-b339-bf22600738a3 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
43032024-09-03T23:54:52.500ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = fd59f3c7-f9d9-4ed3-b339-bf22600738a3 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
43042024-09-03T23:54:52.502ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2278 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = fd59f3c7-f9d9-4ed3-b339-bf22600738a3 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
43052024-09-03T23:54:53.522ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = f132fae0-d4e2-4c13-b08e-bd0e51820fc8 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
43062024-09-03T23:54:53.522ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = f132fae0-d4e2-4c13-b08e-bd0e51820fc8 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
43072024-09-03T23:54:53.524ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1926 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = f132fae0-d4e2-4c13-b08e-bd0e51820fc8 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
43082024-09-03T23:54:54.544ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 0056678d-c237-4049-a2e2-f5e7ba400665 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
43092024-09-03T23:54:54.544ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 0056678d-c237-4049-a2e2-f5e7ba400665 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
43102024-09-03T23:54:54.545ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2096 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 0056678d-c237-4049-a2e2-f5e7ba400665 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
43112024-09-03T23:54:55.564ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 2cf623e6-a74b-468f-8d64-0cbb73083f89 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
43122024-09-03T23:54:55.565ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 2cf623e6-a74b-468f-8d64-0cbb73083f89 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
43132024-09-03T23:54:55.566ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1966 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 2cf623e6-a74b-468f-8d64-0cbb73083f89 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
43142024-09-03T23:54:56.585ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 90aea833-e2ea-4573-98d5-cf8423b5390e roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
43152024-09-03T23:54:56.586ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 90aea833-e2ea-4573-98d5-cf8423b5390e resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
43162024-09-03T23:54:56.587ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2078 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 90aea833-e2ea-4573-98d5-cf8423b5390e response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
43172024-09-03T23:54:57.607ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 1f5ab3f4-7281-4cf7-a090-d1fb6438752d roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
43182024-09-03T23:54:57.607ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 1f5ab3f4-7281-4cf7-a090-d1fb6438752d resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
43192024-09-03T23:54:57.609ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1989 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 1f5ab3f4-7281-4cf7-a090-d1fb6438752d response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
43202024-09-03T23:54:58.629ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = f3a52137-c49e-4c12-ac57-aa4211c9c39f roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
43212024-09-03T23:54:58.629ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = f3a52137-c49e-4c12-ac57-aa4211c9c39f resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
43222024-09-03T23:54:58.631ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2719 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = f3a52137-c49e-4c12-ac57-aa4211c9c39f response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
43232024-09-03T23:54:59.244ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 21 reason = Timeout
43242024-09-03T23:54:59.244ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43252024-09-03T23:54:59.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43262024-09-03T23:54:59.246ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43272024-09-03T23:54:59.249ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
43282024-09-03T23:54:59.249ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43292024-09-03T23:54:59.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43302024-09-03T23:54:59.250ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 21 reason = Timeout
43312024-09-03T23:54:59.250ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43322024-09-03T23:54:59.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43332024-09-03T23:54:59.251ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43342024-09-03T23:54:59.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43352024-09-03T23:54:59.251ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43362024-09-03T23:54:59.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43372024-09-03T23:54:59.253ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43382024-09-03T23:54:59.253ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 2.910423ms iteration = 21 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
43392024-09-03T23:54:59.255ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b1196b3e-aa3c-4486-a0ad-52f372819a8f, lookup_type: ById(b1196b3e-aa3c-4486-a0ad-52f372819a8f) } result = Ok(())
43402024-09-03T23:54:59.255ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43412024-09-03T23:54:59.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43422024-09-03T23:54:59.267ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b1196b3e-aa3c-4486-a0ad-52f372819a8f original_time_created = 2024-09-03 23:51:19.204380 UTC target_id = b1196b3e-aa3c-4486-a0ad-52f372819a8f time_created = 2024-09-03 23:51:19.204380 UTC
43432024-09-03T23:54:59.267ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.419843ms iteration = 21 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b1196b3e-aa3c-4486-a0ad-52f372819a8f","time_created":"2024-09-03T23:51:19.204380Z"}
43442024-09-03T23:54:59.650ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 06807bb4-babb-4239-adbb-d1514fc84bef roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
43452024-09-03T23:54:59.651ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 06807bb4-babb-4239-adbb-d1514fc84bef resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
43462024-09-03T23:54:59.652ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2278 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 06807bb4-babb-4239-adbb-d1514fc84bef response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
43472024-09-03T23:54:59.802ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 491 local_addr = [fd00:1122:3344:101::c]:59395 method = GET remote_addr = [fd00:1122:3344:101::d]:55949 req_id = 1e20a453-3804-49ac-94eb-b50feaba9679 response_code = 200 uri = /5f5ce676-2064-4d97-b873-fbcbc29495de
43482024-09-03T23:55:00.672ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = ff887a16-3d87-4e47-af31-ecce33e53500 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
43492024-09-03T23:55:00.672ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = ff887a16-3d87-4e47-af31-ecce33e53500 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
43502024-09-03T23:55:00.674ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1923 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = ff887a16-3d87-4e47-af31-ecce33e53500 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
43512024-09-03T23:55:01.693ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = f12bcc1e-729b-445a-aa8f-a3b1451d2bce roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
43522024-09-03T23:55:01.693ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = f12bcc1e-729b-445a-aa8f-a3b1451d2bce resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
43532024-09-03T23:55:01.695ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2069 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = f12bcc1e-729b-445a-aa8f-a3b1451d2bce response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
43542024-09-03T23:55:02.715ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 1bcc221d-f350-4592-8fa2-9d8baee76bb4 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
43552024-09-03T23:55:02.715ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 1bcc221d-f350-4592-8fa2-9d8baee76bb4 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
43562024-09-03T23:55:02.717ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2019 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 1bcc221d-f350-4592-8fa2-9d8baee76bb4 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
43572024-09-03T23:55:03.736ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = e4fb9fec-1f25-427b-8a04-0612c991bf40 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
43582024-09-03T23:55:03.736ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = e4fb9fec-1f25-427b-8a04-0612c991bf40 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
43592024-09-03T23:55:03.738ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1783 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = e4fb9fec-1f25-427b-8a04-0612c991bf40 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
43602024-09-03T23:55:04.758ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = fc467c76-356d-4f0a-87cb-ffa5b1404e64 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
43612024-09-03T23:55:04.758ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = fc467c76-356d-4f0a-87cb-ffa5b1404e64 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
43622024-09-03T23:55:04.760ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2822 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = fc467c76-356d-4f0a-87cb-ffa5b1404e64 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
43632024-09-03T23:55:05.780ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 7adb84bd-e575-48b2-87a4-cc44b9ae0efc roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
43642024-09-03T23:55:05.780ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 7adb84bd-e575-48b2-87a4-cc44b9ae0efc resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
43652024-09-03T23:55:05.782ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2426 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 7adb84bd-e575-48b2-87a4-cc44b9ae0efc response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
43662024-09-03T23:55:06.801ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 7361655c-cabf-4210-b1e0-2c54a4c174af roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
43672024-09-03T23:55:06.801ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 7361655c-cabf-4210-b1e0-2c54a4c174af resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
43682024-09-03T23:55:06.803ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1984 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 7361655c-cabf-4210-b1e0-2c54a4c174af response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
43692024-09-03T23:55:07.823ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 7594b381-3df4-476d-a3ea-d8d5584b59b8 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
43702024-09-03T23:55:07.823ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 7594b381-3df4-476d-a3ea-d8d5584b59b8 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
43712024-09-03T23:55:07.824ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1922 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 7594b381-3df4-476d-a3ea-d8d5584b59b8 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
43722024-09-03T23:55:08.843ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 8178640d-2ea6-403d-93cc-11cd99601a0b roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
43732024-09-03T23:55:08.844ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 8178640d-2ea6-403d-93cc-11cd99601a0b resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
43742024-09-03T23:55:08.845ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2179 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 8178640d-2ea6-403d-93cc-11cd99601a0b response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
43752024-09-03T23:55:09.245ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 8 reason = Timeout
43762024-09-03T23:55:09.245ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 22 reason = Timeout
43772024-09-03T23:55:09.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43782024-09-03T23:55:09.245ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 8 reason = Timeout
43792024-09-03T23:55:09.245ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 8 reason = Timeout
43802024-09-03T23:55:09.245ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
43812024-09-03T23:55:09.245ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
43822024-09-03T23:55:09.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
43832024-09-03T23:55:09.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43842024-09-03T23:55:09.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
43852024-09-03T23:55:09.246ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 8 reason = Timeout
43862024-09-03T23:55:09.246ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 8 reason = Timeout
43872024-09-03T23:55:09.246ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
43882024-09-03T23:55:09.246ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 10 reason = Timeout
43892024-09-03T23:55:09.246ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
43902024-09-03T23:55:09.246ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 8 reason = Timeout
43912024-09-03T23:55:09.246ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43922024-09-03T23:55:09.246ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43932024-09-03T23:55:09.246ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 8 reason = Timeout
43942024-09-03T23:55:09.246ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43952024-09-03T23:55:09.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
43962024-09-03T23:55:09.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
43972024-09-03T23:55:09.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43982024-09-03T23:55:09.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43992024-09-03T23:55:09.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44002024-09-03T23:55:09.248ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44012024-09-03T23:55:09.249ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b281022b-35b2-452e-ad2b-78e12f6ca16a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b281022b-35b2-452e-ad2b-78e12f6ca16a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1287, tv_nsec: 751230863 } })
44022024-09-03T23:55:09.250ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.505118ms iteration = 8 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
44032024-09-03T23:55:09.250ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 8 reason = Timeout
44042024-09-03T23:55:09.250ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 22 reason = Timeout
44052024-09-03T23:55:09.250ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44062024-09-03T23:55:09.250ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44072024-09-03T23:55:09.250ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 8 reason = Timeout
44082024-09-03T23:55:09.250ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
44092024-09-03T23:55:09.250ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 8 reason = Timeout
44102024-09-03T23:55:09.250ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
44112024-09-03T23:55:09.250ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 8 reason = Timeout
44122024-09-03T23:55:09.250ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 8 reason = Timeout
44132024-09-03T23:55:09.250ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
44142024-09-03T23:55:09.250ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 8 reason = Timeout
44152024-09-03T23:55:09.250ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
44162024-09-03T23:55:09.250ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
44172024-09-03T23:55:09.250ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 8 reason = Timeout
44182024-09-03T23:55:09.251ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
44192024-09-03T23:55:09.251ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
44202024-09-03T23:55:09.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44212024-09-03T23:55:09.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
44222024-09-03T23:55:09.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44232024-09-03T23:55:09.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
44242024-09-03T23:55:09.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
44252024-09-03T23:55:09.251ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b281022b-35b2-452e-ad2b-78e12f6ca16a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b281022b-35b2-452e-ad2b-78e12f6ca16a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1287, tv_nsec: 752845617 } })
44262024-09-03T23:55:09.251ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
44272024-09-03T23:55:09.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
44282024-09-03T23:55:09.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
44292024-09-03T23:55:09.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
44302024-09-03T23:55:09.251ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
44312024-09-03T23:55:09.253ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
44322024-09-03T23:55:09.253ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44332024-09-03T23:55:09.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44342024-09-03T23:55:09.255ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44352024-09-03T23:55:09.256ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44362024-09-03T23:55:09.256ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44372024-09-03T23:55:09.258ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
44382024-09-03T23:55:09.258ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44392024-09-03T23:55:09.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44402024-09-03T23:55:09.259ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
44412024-09-03T23:55:09.259ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44422024-09-03T23:55:09.259ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
44432024-09-03T23:55:09.259ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44442024-09-03T23:55:09.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44452024-09-03T23:55:09.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44462024-09-03T23:55:09.261ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44472024-09-03T23:55:09.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44482024-09-03T23:55:09.261ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 10.892694ms iteration = 8 status = {"errors":[],"garbage_collect_requested":[]}
44492024-09-03T23:55:09.266ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44502024-09-03T23:55:09.267ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44512024-09-03T23:55:09.268ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
44522024-09-03T23:55:09.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
44532024-09-03T23:55:09.269ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b281022b-35b2-452e-ad2b-78e12f6ca16a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b281022b-35b2-452e-ad2b-78e12f6ca16a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1287, tv_nsec: 771225453 } })
44542024-09-03T23:55:09.271ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44552024-09-03T23:55:09.271ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 20.280227ms iteration = 22 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
44562024-09-03T23:55:09.271ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df
44572024-09-03T23:55:09.271ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44582024-09-03T23:55:09.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44592024-09-03T23:55:09.272ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44602024-09-03T23:55:09.273ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
44612024-09-03T23:55:09.273ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44622024-09-03T23:55:09.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44632024-09-03T23:55:09.275ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b1196b3e-aa3c-4486-a0ad-52f372819a8f, lookup_type: ById(b1196b3e-aa3c-4486-a0ad-52f372819a8f) } result = Ok(())
44642024-09-03T23:55:09.275ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44652024-09-03T23:55:09.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44662024-09-03T23:55:09.280ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44672024-09-03T23:55:09.283ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
44682024-09-03T23:55:09.283ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
44692024-09-03T23:55:09.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
44702024-09-03T23:55:09.285ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b1196b3e-aa3c-4486-a0ad-52f372819a8f original_time_created = 2024-09-03 23:51:19.204380 UTC target_id = b1196b3e-aa3c-4486-a0ad-52f372819a8f time_created = 2024-09-03 23:51:19.204380 UTC
44712024-09-03T23:55:09.285ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 40.030192ms iteration = 22 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b1196b3e-aa3c-4486-a0ad-52f372819a8f","time_created":"2024-09-03T23:51:19.204380Z"}
44722024-09-03T23:55:09.285ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
44732024-09-03T23:55:09.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
44742024-09-03T23:55:09.287ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44752024-09-03T23:55:09.289ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
44762024-09-03T23:55:09.289ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
44772024-09-03T23:55:09.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
44782024-09-03T23:55:09.294ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
44792024-09-03T23:55:09.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
44802024-09-03T23:55:09.296ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 50.051948ms iteration = 8 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
44812024-09-03T23:55:09.297ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44822024-09-03T23:55:09.297ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 46.634815ms iteration = 8 status = {"errors":[],"records_set_to_done":[]}
44832024-09-03T23:55:09.300ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
44842024-09-03T23:55:09.300ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
44852024-09-03T23:55:09.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
44862024-09-03T23:55:09.301ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44872024-09-03T23:55:09.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44882024-09-03T23:55:09.306ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44892024-09-03T23:55:09.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44902024-09-03T23:55:09.308ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
44912024-09-03T23:55:09.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
44922024-09-03T23:55:09.310ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44932024-09-03T23:55:09.310ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
44942024-09-03T23:55:09.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
44952024-09-03T23:55:09.312ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
44962024-09-03T23:55:09.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
44972024-09-03T23:55:09.312ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: b281022b-35b2-452e-ad2b-78e12f6ca16a, lookup_type: ById(b281022b-35b2-452e-ad2b-78e12f6ca16a) } result = Ok(())
44982024-09-03T23:55:09.312ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44992024-09-03T23:55:09.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45002024-09-03T23:55:09.315ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 69.413655ms iteration = 8 status = 0
45012024-09-03T23:55:09.318ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:56
45022024-09-03T23:55:09.318ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
45032024-09-03T23:55:09.318ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
45042024-09-03T23:55:09.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
45052024-09-03T23:55:09.324ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
45062024-09-03T23:55:09.324ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
45072024-09-03T23:55:09.324ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d353a2ed-1d2c-463b-bc17-19384c5bea28", "content-length": "26", "date": "Tue, 03 Sep 2024 23:55:09 GMT"} })
45082024-09-03T23:55:09.324ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
45092024-09-03T23:55:09.325ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
45102024-09-03T23:55:09.345ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 94.301721ms iteration = 8 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
45112024-09-03T23:55:09.347ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:56
45122024-09-03T23:55:09.347ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
45132024-09-03T23:55:09.347ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
45142024-09-03T23:55:09.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
45152024-09-03T23:55:09.348ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 97.473229ms iteration = 8 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
45162024-09-03T23:55:09.377ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:56
45172024-09-03T23:55:09.377ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:241 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
45182024-09-03T23:55:09.377ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 126.550075ms iteration = 8 status = {"destroyed_active_vmms":0,"error":null,"failed_active_vmms":0,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
45192024-09-03T23:55:09.381ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
45202024-09-03T23:55:09.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45212024-09-03T23:55:09.382ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
45222024-09-03T23:55:09.382ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
45232024-09-03T23:55:09.383ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c1c88512-f9ed-422f-a424-bddda91d40e7", "content-length": "26", "date": "Tue, 03 Sep 2024 23:55:09 GMT"} })
45242024-09-03T23:55:09.383ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
45252024-09-03T23:55:09.383ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45262024-09-03T23:55:09.385ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
45272024-09-03T23:55:09.385ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
45282024-09-03T23:55:09.385ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
45292024-09-03T23:55:09.386ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45302024-09-03T23:55:09.399ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 153.111117ms iteration = 10 status = {"physical_disks_added":0}
45312024-09-03T23:55:09.403ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:480 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
45322024-09-03T23:55:09.403ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 152.564365ms iteration = 8 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
45332024-09-03T23:55:09.418ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df zone_address = fd00:1122:3344:101::2
45342024-09-03T23:55:09.418ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
45352024-09-03T23:55:09.419ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "4afd204b-f158-416d-9f57-86b6855c59db", "content-length": "26", "date": "Tue, 03 Sep 2024 23:55:09 GMT"} })
45362024-09-03T23:55:09.419ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
45372024-09-03T23:55:09.421ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df
45382024-09-03T23:55:09.424ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 179.070986ms iteration = 8 status = {}
45392024-09-03T23:55:09.439ZDEBGnexus (BackgroundTasks): client request SledAgent = b281022b-35b2-452e-ad2b-78e12f6ca16a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
45402024-09-03T23:55:09.440ZDEBGnexus (BackgroundTasks): client response SledAgent = b281022b-35b2-452e-ad2b-78e12f6ca16a background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f57db238-e073-4984-ad63-ecd9f2f67bc5", "content-length": "372", "date": "Tue, 03 Sep 2024 23:55:09 GMT"} })
45412024-09-03T23:55:09.440ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45422024-09-03T23:55:09.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45432024-09-03T23:55:09.441ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45442024-09-03T23:55:09.443ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
45452024-09-03T23:55:09.443ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
45462024-09-03T23:55:09.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45472024-09-03T23:55:09.468ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
45482024-09-03T23:55:09.469ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "8be57996-71fd-4d55-9177-c81d3029c1d8", "content-length": "1", "date": "Tue, 03 Sep 2024 23:55:09 GMT"} })
45492024-09-03T23:55:09.470ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
45502024-09-03T23:55:09.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
45512024-09-03T23:55:09.473ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 228.004651ms iteration = 8 status = null
45522024-09-03T23:55:09.516ZDEBGnexus (BackgroundTasks): client request SledAgent = b281022b-35b2-452e-ad2b-78e12f6ca16a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
45532024-09-03T23:55:09.516ZDEBGnexus (BackgroundTasks): client response SledAgent = b281022b-35b2-452e-ad2b-78e12f6ca16a background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b2c24f97-f85f-492d-9391-c8246853aa59", "content-length": "691", "date": "Tue, 03 Sep 2024 23:55:09 GMT"} })
45542024-09-03T23:55:09.516ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
45552024-09-03T23:55:09.516ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
45562024-09-03T23:55:09.516ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
45572024-09-03T23:55:09.518ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 272.053319ms iteration = 8 status = {}
45582024-09-03T23:55:09.546ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45592024-09-03T23:55:09.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45602024-09-03T23:55:09.549ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45612024-09-03T23:55:09.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45622024-09-03T23:55:09.552ZDEBGnexus (BackgroundTasks): client request SledAgent = b281022b-35b2-452e-ad2b-78e12f6ca16a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
45632024-09-03T23:55:09.568ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45642024-09-03T23:55:09.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45652024-09-03T23:55:09.570ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: ec64e2ff-6fd0-4ab3-a8fa-a8a710b73297, rack_id: 1d4636f4-828e-412a-8daf-3bda355c92df, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(ccbb015a-58a4-4f0f-8a1a-5716d0b9db06) } rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df switch_location = Switch0
45662024-09-03T23:55:09.570ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45672024-09-03T23:55:09.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45682024-09-03T23:55:09.579ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
45692024-09-03T23:55:09.580ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "2215e32d-71a9-45ab-8d7e-cc272c698b84", "content-length": "121", "date": "Tue, 03 Sep 2024 23:55:09 GMT"} })
45702024-09-03T23:55:09.580ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
45712024-09-03T23:55:09.580ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = ccbb015a-58a4-4f0f-8a1a-5716d0b9db06
45722024-09-03T23:55:09.580ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
45732024-09-03T23:55:09.580ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
45742024-09-03T23:55:09.580ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df routes = {}
45752024-09-03T23:55:09.580ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df routes = {}
45762024-09-03T23:55:09.580ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df
45772024-09-03T23:55:09.580ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45782024-09-03T23:55:09.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45792024-09-03T23:55:09.596ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
45802024-09-03T23:55:09.596ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "16ff4e04-51d2-4d3f-9157-286fe8c395f6", "content-length": "2", "date": "Tue, 03 Sep 2024 23:55:09 GMT"} })
45812024-09-03T23:55:09.596ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
45822024-09-03T23:55:09.597ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "cf1e7e5f-bcec-45e4-b52f-0e933d5db6d2", "content-length": "52", "date": "Tue, 03 Sep 2024 23:55:09 GMT"} })
45832024-09-03T23:55:09.597ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df switch_location = Switch0
45842024-09-03T23:55:09.597ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
45852024-09-03T23:55:09.643ZDEBGnexus (BackgroundTasks): client response SledAgent = b281022b-35b2-452e-ad2b-78e12f6ca16a background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "68b4a239-c8c3-45d6-8596-9251a4996430", "date": "Tue, 03 Sep 2024 23:55:09 GMT"} })
45862024-09-03T23:55:09.644ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 393.686358ms iteration = 8 status = {}
45872024-09-03T23:55:09.735ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "73a9e147-2279-4e7e-9dd1-578c6610f2dd", "date": "Tue, 03 Sep 2024 23:55:09 GMT"} })
45882024-09-03T23:55:09.735ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df switch = Switch0
45892024-09-03T23:55:09.735ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
45902024-09-03T23:55:09.736ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "5807d6c0-7263-4422-b6cf-f133104adb26", "content-length": "667", "date": "Tue, 03 Sep 2024 23:55:09 GMT"} })
45912024-09-03T23:55:09.736ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45922024-09-03T23:55:09.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45932024-09-03T23:55:09.739ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45942024-09-03T23:55:09.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45952024-09-03T23:55:09.745ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45962024-09-03T23:55:09.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45972024-09-03T23:55:09.748ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45982024-09-03T23:55:09.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45992024-09-03T23:55:09.757ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 511.386453ms iteration = 8 status = {}
46002024-09-03T23:55:09.773ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
46012024-09-03T23:55:09.773ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
46022024-09-03T23:55:09.804ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
46032024-09-03T23:55:09.804ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:36515
46042024-09-03T23:55:09.804ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:36515 req_id = cdc45cd0-4856-4c70-bd2c-0bdeea7b96ee roles = RoleSet { roles: {} } uri = /metrics/producers
46052024-09-03T23:55:09.805ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:36515 req_id = cdc45cd0-4856-4c70-bd2c-0bdeea7b96ee resource = Database result = Ok(()) uri = /metrics/producers
46062024-09-03T23:55:09.805ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 521 local_addr = [fd00:1122:3344:101::c]:59395 method = GET remote_addr = [fd00:1122:3344:101::d]:55949 req_id = 7ad67d8e-4267-46d6-b9b9-1dcfd46870da response_code = 200 uri = /5f5ce676-2064-4d97-b873-fbcbc29495de
46072024-09-03T23:55:09.841ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 022d3a36-e465-40ec-b1ab-e6f9700e76c8
46082024-09-03T23:55:09.841ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:36515 req_id = cdc45cd0-4856-4c70-bd2c-0bdeea7b96ee roles = RoleSet { roles: {} } uri = /metrics/producers
46092024-09-03T23:55:09.842ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:36515 req_id = cdc45cd0-4856-4c70-bd2c-0bdeea7b96ee resource = Database result = Ok(()) uri = /metrics/producers
46102024-09-03T23:55:09.865ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = d0439e6a-eaf4-49a8-a0a1-9f20a4c105ff roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
46112024-09-03T23:55:09.865ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = d0439e6a-eaf4-49a8-a0a1-9f20a4c105ff resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
46122024-09-03T23:55:09.867ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2611 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = d0439e6a-eaf4-49a8-a0a1-9f20a4c105ff response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
46132024-09-03T23:55:09.878ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 022d3a36-e465-40ec-b1ab-e6f9700e76c8 uri = http://[fd00:1122:3344:101::d]:12223/producers
46142024-09-03T23:55:09.878ZDEBGnexus: client response oximeter-collector = 022d3a36-e465-40ec-b1ab-e6f9700e76c8 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "82266de0-256a-4c33-b17e-251da4671c19", "date": "Tue, 03 Sep 2024 23:55:09 GMT"} })
46152024-09-03T23:55:09.878ZINFOnexus: assigned collector to new producer collector_id = 022d3a36-e465-40ec-b1ab-e6f9700e76c8 file = nexus/src/app/oximeter.rs:125 producer_id = 5f5ce676-2064-4d97-b873-fbcbc29495de
46162024-09-03T23:55:09.879ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 74987 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:36515 req_id = cdc45cd0-4856-4c70-bd2c-0bdeea7b96ee response_code = 201 uri = /metrics/producers
46172024-09-03T23:55:09.879ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::c)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, status: 201, headers: {"content-type": "application/json", "x-request-id": "cdc45cd0-4856-4c70-bd2c-0bdeea7b96ee", "content-length": "41", "date": "Tue, 03 Sep 2024 23:55:09 GMT"} })
46182024-09-03T23:55:09.881ZDEBGnexus (producer-registration-task): registered with nexus successfully
46192024-09-03T23:55:09.881ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
46202024-09-03T23:55:10.530ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50060 req_id = 7fb7d8ca-3557-44b2-9a3f-bba5bdb65baf roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
46212024-09-03T23:55:10.530ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50060 req_id = 7fb7d8ca-3557-44b2-9a3f-bba5bdb65baf resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
46222024-09-03T23:55:10.533ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3121 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50060 req_id = 7fb7d8ca-3557-44b2-9a3f-bba5bdb65baf response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
46232024-09-03T23:55:10.888ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = fc0d459b-16aa-4421-b061-b8a0d94cf46f roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
46242024-09-03T23:55:10.888ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = fc0d459b-16aa-4421-b061-b8a0d94cf46f resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
46252024-09-03T23:55:10.890ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1845 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = fc0d459b-16aa-4421-b061-b8a0d94cf46f response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
46262024-09-03T23:55:11.909ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = efa0d7f6-233c-4b06-a2b4-fb93c44091ab roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
46272024-09-03T23:55:11.910ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = efa0d7f6-233c-4b06-a2b4-fb93c44091ab resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
46282024-09-03T23:55:11.911ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1875 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = efa0d7f6-233c-4b06-a2b4-fb93c44091ab response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
46292024-09-03T23:55:12.933ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 3d260695-3b19-47a3-8d40-f87828110408 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
46302024-09-03T23:55:12.933ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 3d260695-3b19-47a3-8d40-f87828110408 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
46312024-09-03T23:55:12.934ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1859 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 3d260695-3b19-47a3-8d40-f87828110408 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
46322024-09-03T23:55:13.955ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 22f26aec-2fc8-4eee-9d13-399dc9268dbc roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
46332024-09-03T23:55:13.955ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 22f26aec-2fc8-4eee-9d13-399dc9268dbc resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
46342024-09-03T23:55:13.956ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2397 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 22f26aec-2fc8-4eee-9d13-399dc9268dbc response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
46352024-09-03T23:55:14.977ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 6081ca8b-d4b3-47fd-b498-97958b89eb40 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
46362024-09-03T23:55:14.977ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 6081ca8b-d4b3-47fd-b498-97958b89eb40 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
46372024-09-03T23:55:14.979ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2178 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 6081ca8b-d4b3-47fd-b498-97958b89eb40 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
46382024-09-03T23:55:15.999ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = d33f66e3-832d-437d-a109-1e3c90f45b72 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
46392024-09-03T23:55:15.999ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = d33f66e3-832d-437d-a109-1e3c90f45b72 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
46402024-09-03T23:55:16.001ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2125 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = d33f66e3-832d-437d-a109-1e3c90f45b72 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
46412024-09-03T23:55:17.021ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = ddb2f6d5-1c42-40f9-af55-12c9eaa8b4d7 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
46422024-09-03T23:55:17.021ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = ddb2f6d5-1c42-40f9-af55-12c9eaa8b4d7 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
46432024-09-03T23:55:17.023ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1770 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = ddb2f6d5-1c42-40f9-af55-12c9eaa8b4d7 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
46442024-09-03T23:55:18.042ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 71cef990-cff3-4f59-b2c2-1f5dd20842e9 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
46452024-09-03T23:55:18.042ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 71cef990-cff3-4f59-b2c2-1f5dd20842e9 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
46462024-09-03T23:55:18.044ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2642 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 71cef990-cff3-4f59-b2c2-1f5dd20842e9 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
46472024-09-03T23:55:19.066ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 010aafff-4fd8-4f8d-bcc8-adc3c62f439e roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
46482024-09-03T23:55:19.066ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 010aafff-4fd8-4f8d-bcc8-adc3c62f439e resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
46492024-09-03T23:55:19.068ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2785 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 010aafff-4fd8-4f8d-bcc8-adc3c62f439e response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
46502024-09-03T23:55:19.244ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 23 reason = Timeout
46512024-09-03T23:55:19.244ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46522024-09-03T23:55:19.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46532024-09-03T23:55:19.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46542024-09-03T23:55:19.248ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
46552024-09-03T23:55:19.248ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46562024-09-03T23:55:19.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46572024-09-03T23:55:19.250ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46582024-09-03T23:55:19.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46592024-09-03T23:55:19.250ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 23 reason = Timeout
46602024-09-03T23:55:19.250ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46612024-09-03T23:55:19.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46622024-09-03T23:55:19.251ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46632024-09-03T23:55:19.252ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46642024-09-03T23:55:19.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46652024-09-03T23:55:19.253ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.039845ms iteration = 23 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
46662024-09-03T23:55:19.254ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b1196b3e-aa3c-4486-a0ad-52f372819a8f, lookup_type: ById(b1196b3e-aa3c-4486-a0ad-52f372819a8f) } result = Ok(())
46672024-09-03T23:55:19.254ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46682024-09-03T23:55:19.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46692024-09-03T23:55:19.261ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b1196b3e-aa3c-4486-a0ad-52f372819a8f original_time_created = 2024-09-03 23:51:19.204380 UTC target_id = b1196b3e-aa3c-4486-a0ad-52f372819a8f time_created = 2024-09-03 23:51:19.204380 UTC
46702024-09-03T23:55:19.261ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 16.896744ms iteration = 23 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b1196b3e-aa3c-4486-a0ad-52f372819a8f","time_created":"2024-09-03T23:51:19.204380Z"}
46712024-09-03T23:55:19.880ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 593 local_addr = [fd00:1122:3344:101::c]:59395 method = GET remote_addr = [fd00:1122:3344:101::d]:55949 req_id = 8672fe48-6a86-4c1c-8398-cdd500df0fb9 response_code = 200 uri = /5f5ce676-2064-4d97-b873-fbcbc29495de
46722024-09-03T23:55:20.089ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = fbd25da6-6879-4483-8687-c0521bcf173c roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
46732024-09-03T23:55:20.089ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = fbd25da6-6879-4483-8687-c0521bcf173c resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
46742024-09-03T23:55:20.091ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2654 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = fbd25da6-6879-4483-8687-c0521bcf173c response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
46752024-09-03T23:55:21.112ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 859146d4-c5e8-40df-887f-eb1d6df4b104 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
46762024-09-03T23:55:21.112ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 859146d4-c5e8-40df-887f-eb1d6df4b104 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
46772024-09-03T23:55:21.113ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2056 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 859146d4-c5e8-40df-887f-eb1d6df4b104 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
46782024-09-03T23:55:22.134ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = a7ecc2b4-35a2-493d-9b6f-e1e5cfd9685c roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
46792024-09-03T23:55:22.135ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = a7ecc2b4-35a2-493d-9b6f-e1e5cfd9685c resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
46802024-09-03T23:55:22.136ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2196 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = a7ecc2b4-35a2-493d-9b6f-e1e5cfd9685c response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
46812024-09-03T23:55:23.158ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 582f1366-3fa9-4cef-9650-d0e9a7216225 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
46822024-09-03T23:55:23.158ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 582f1366-3fa9-4cef-9650-d0e9a7216225 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
46832024-09-03T23:55:23.160ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2453 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 582f1366-3fa9-4cef-9650-d0e9a7216225 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
46842024-09-03T23:55:24.181ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 2cbfa780-7329-48cb-b5b4-8391ba26cf02 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
46852024-09-03T23:55:24.181ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 2cbfa780-7329-48cb-b5b4-8391ba26cf02 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
46862024-09-03T23:55:24.183ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2106 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 2cbfa780-7329-48cb-b5b4-8391ba26cf02 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
46872024-09-03T23:55:25.204ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 6c3bb2c8-8b7a-44e6-87c2-132b5048e9be roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
46882024-09-03T23:55:25.204ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 6c3bb2c8-8b7a-44e6-87c2-132b5048e9be resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
46892024-09-03T23:55:25.206ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2622 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 6c3bb2c8-8b7a-44e6-87c2-132b5048e9be response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
46902024-09-03T23:55:26.226ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 2a5c59cb-aa93-40bd-a06d-5a686d4c4588 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
46912024-09-03T23:55:26.226ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 2a5c59cb-aa93-40bd-a06d-5a686d4c4588 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
46922024-09-03T23:55:26.227ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1724 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 2a5c59cb-aa93-40bd-a06d-5a686d4c4588 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
46932024-09-03T23:55:27.247ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 2d9f4b2a-3853-433f-965b-b8cd48a6e4d0 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
46942024-09-03T23:55:27.248ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 2d9f4b2a-3853-433f-965b-b8cd48a6e4d0 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
46952024-09-03T23:55:27.250ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2338 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 2d9f4b2a-3853-433f-965b-b8cd48a6e4d0 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
46962024-09-03T23:55:28.270ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 05121e0a-9c68-4413-a2a4-1da979e2f5e8 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
46972024-09-03T23:55:28.270ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 05121e0a-9c68-4413-a2a4-1da979e2f5e8 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
46982024-09-03T23:55:28.272ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2059 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 05121e0a-9c68-4413-a2a4-1da979e2f5e8 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
46992024-09-03T23:55:29.244ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 24 reason = Timeout
47002024-09-03T23:55:29.244ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47012024-09-03T23:55:29.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47022024-09-03T23:55:29.246ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47032024-09-03T23:55:29.248ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
47042024-09-03T23:55:29.249ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47052024-09-03T23:55:29.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47062024-09-03T23:55:29.250ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 24 reason = Timeout
47072024-09-03T23:55:29.250ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47082024-09-03T23:55:29.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47092024-09-03T23:55:29.250ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47102024-09-03T23:55:29.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47112024-09-03T23:55:29.252ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47122024-09-03T23:55:29.254ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b1196b3e-aa3c-4486-a0ad-52f372819a8f, lookup_type: ById(b1196b3e-aa3c-4486-a0ad-52f372819a8f) } result = Ok(())
47132024-09-03T23:55:29.254ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47142024-09-03T23:55:29.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47152024-09-03T23:55:29.262ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b1196b3e-aa3c-4486-a0ad-52f372819a8f original_time_created = 2024-09-03 23:51:19.204380 UTC target_id = b1196b3e-aa3c-4486-a0ad-52f372819a8f time_created = 2024-09-03 23:51:19.204380 UTC
47162024-09-03T23:55:29.262ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.083899ms iteration = 24 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b1196b3e-aa3c-4486-a0ad-52f372819a8f","time_created":"2024-09-03T23:51:19.204380Z"}
47172024-09-03T23:55:29.276ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47182024-09-03T23:55:29.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47192024-09-03T23:55:29.278ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 28.388641ms iteration = 24 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
47202024-09-03T23:55:29.291ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 912efe36-5b88-4d41-8972-ccf8ad401c3d roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
47212024-09-03T23:55:29.292ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 912efe36-5b88-4d41-8972-ccf8ad401c3d resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
47222024-09-03T23:55:29.293ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1866 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 912efe36-5b88-4d41-8972-ccf8ad401c3d response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
47232024-09-03T23:55:29.880ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 496 local_addr = [fd00:1122:3344:101::c]:59395 method = GET remote_addr = [fd00:1122:3344:101::d]:55949 req_id = 21c3b51f-0a8b-4fb9-ad0c-1fd58d70fcd6 response_code = 200 uri = /5f5ce676-2064-4d97-b873-fbcbc29495de
47242024-09-03T23:55:30.314ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = b0c3a93e-69ef-439e-bd0e-d3f190a9d064 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
47252024-09-03T23:55:30.314ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = b0c3a93e-69ef-439e-bd0e-d3f190a9d064 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
47262024-09-03T23:55:30.315ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1744 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = b0c3a93e-69ef-439e-bd0e-d3f190a9d064 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
47272024-09-03T23:55:31.336ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 90d7a4e8-5737-49e1-8f99-2b332315326f roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
47282024-09-03T23:55:31.336ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 90d7a4e8-5737-49e1-8f99-2b332315326f resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
47292024-09-03T23:55:31.337ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1767 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 90d7a4e8-5737-49e1-8f99-2b332315326f response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
47302024-09-03T23:55:32.357ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 71368b18-6fad-43c2-a903-99746db2178b roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
47312024-09-03T23:55:32.357ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 71368b18-6fad-43c2-a903-99746db2178b resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
47322024-09-03T23:55:32.359ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2045 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 71368b18-6fad-43c2-a903-99746db2178b response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
47332024-09-03T23:55:33.379ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 6c54bda0-0716-4d4a-a3a8-103fd7cbfcc1 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
47342024-09-03T23:55:33.379ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 6c54bda0-0716-4d4a-a3a8-103fd7cbfcc1 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
47352024-09-03T23:55:33.381ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2184 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 6c54bda0-0716-4d4a-a3a8-103fd7cbfcc1 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
47362024-09-03T23:55:34.402ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 771a5af3-9fcb-4b54-8248-547172d4d79c roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
47372024-09-03T23:55:34.402ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 771a5af3-9fcb-4b54-8248-547172d4d79c resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
47382024-09-03T23:55:34.404ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2032 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 771a5af3-9fcb-4b54-8248-547172d4d79c response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
47392024-09-03T23:55:35.424ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 06048f75-5eae-4698-abdd-d7d4ad2aba3f roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
47402024-09-03T23:55:35.424ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 06048f75-5eae-4698-abdd-d7d4ad2aba3f resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
47412024-09-03T23:55:35.426ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1710 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 06048f75-5eae-4698-abdd-d7d4ad2aba3f response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
47422024-09-03T23:55:36.446ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 24328d54-de5d-4d57-b84f-a4e0204ee483 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
47432024-09-03T23:55:36.447ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 24328d54-de5d-4d57-b84f-a4e0204ee483 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
47442024-09-03T23:55:36.449ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2821 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 24328d54-de5d-4d57-b84f-a4e0204ee483 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
47452024-09-03T23:55:37.468ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 358f83a5-4269-4587-ba0f-d6301f775f48 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
47462024-09-03T23:55:37.468ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 358f83a5-4269-4587-ba0f-d6301f775f48 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
47472024-09-03T23:55:37.470ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2133 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 358f83a5-4269-4587-ba0f-d6301f775f48 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
47482024-09-03T23:55:38.489ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 2d100671-937f-4b2f-8f52-9918cac955c4 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
47492024-09-03T23:55:38.490ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 2d100671-937f-4b2f-8f52-9918cac955c4 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
47502024-09-03T23:55:38.492ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2464 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 2d100671-937f-4b2f-8f52-9918cac955c4 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
47512024-09-03T23:55:39.244ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 7 reason = Timeout
47522024-09-03T23:55:39.244ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 25 reason = Timeout
47532024-09-03T23:55:39.244ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 5 reason = Timeout
47542024-09-03T23:55:39.244ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47552024-09-03T23:55:39.244ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-09-03 23:45:39.244349425 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
47562024-09-03T23:55:39.244ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
47572024-09-03T23:55:39.244ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 5 reason = Timeout
47582024-09-03T23:55:39.244ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 9 reason = Timeout
47592024-09-03T23:55:39.244ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
47602024-09-03T23:55:39.244ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 7 reason = Timeout
47612024-09-03T23:55:39.244ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 5 reason = Timeout
47622024-09-03T23:55:39.244ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 5 reason = Timeout
47632024-09-03T23:55:39.244ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 9 reason = Timeout
47642024-09-03T23:55:39.244ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
47652024-09-03T23:55:39.244ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 9 reason = Timeout
47662024-09-03T23:55:39.244ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
47672024-09-03T23:55:39.244ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 5 reason = Timeout
47682024-09-03T23:55:39.244ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
47692024-09-03T23:55:39.244ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 5 reason = Timeout
47702024-09-03T23:55:39.244ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
47712024-09-03T23:55:39.244ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
47722024-09-03T23:55:39.244ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
47732024-09-03T23:55:39.244ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 6 reason = Timeout
47742024-09-03T23:55:39.244ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = b1196b3e-aa3c-4486-a0ad-52f372819a8f
47752024-09-03T23:55:39.244ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.331\u{b5}s iteration = 6 status = {"enabled":false,"target_id":"b1196b3e-aa3c-4486-a0ad-52f372819a8f"}
47762024-09-03T23:55:39.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
47772024-09-03T23:55:39.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
47782024-09-03T23:55:39.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47792024-09-03T23:55:39.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
47802024-09-03T23:55:39.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
47812024-09-03T23:55:39.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
47822024-09-03T23:55:39.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
47832024-09-03T23:55:39.246ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 9 reason = Timeout
47842024-09-03T23:55:39.246ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 9 reason = Timeout
47852024-09-03T23:55:39.246ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 11 reason = Timeout
47862024-09-03T23:55:39.246ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47872024-09-03T23:55:39.246ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47882024-09-03T23:55:39.246ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
47892024-09-03T23:55:39.246ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 5 reason = Timeout
47902024-09-03T23:55:39.246ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
47912024-09-03T23:55:39.246ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 9 reason = Timeout
47922024-09-03T23:55:39.246ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
47932024-09-03T23:55:39.246ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 9 reason = Timeout
47942024-09-03T23:55:39.246ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
47952024-09-03T23:55:39.246ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
47962024-09-03T23:55:39.246ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1f2af9fb-1e02-483c-afd2-2b8742b46afd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("90a0c753-ce30-4bd3-a374-17c504cb8aee.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("90a0c753-ce30-4bd3-a374-17c504cb8aee.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1317, tv_nsec: 748056684 } })
47972024-09-03T23:55:39.246ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("321ab50f-2ef5-4620-bbd0-13eba6f06554.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("32795d59-c08e-49d2-b2b0-79f550835c9d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a7781486-6706-487a-a86f-e75908a89f03.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("a7781486-6706-487a-a86f-e75908a89f03.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1317, tv_nsec: 748095525 } })
47982024-09-03T23:55:39.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
47992024-09-03T23:55:39.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48002024-09-03T23:55:39.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48012024-09-03T23:55:39.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
48022024-09-03T23:55:39.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
48032024-09-03T23:55:39.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
48042024-09-03T23:55:39.248ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
48052024-09-03T23:55:39.248ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-09-03 23:45:39.244349425 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
48062024-09-03T23:55:39.248ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.962916ms iteration = 5 status = {"expiration":"2024-09-03T23:45:39.244349425Z","pruned":[]}
48072024-09-03T23:55:39.248ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48082024-09-03T23:55:39.248ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48092024-09-03T23:55:39.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
48102024-09-03T23:55:39.249ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
48112024-09-03T23:55:39.249ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 4.62928ms iteration = 5 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
48122024-09-03T23:55:39.250ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b281022b-35b2-452e-ad2b-78e12f6ca16a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b281022b-35b2-452e-ad2b-78e12f6ca16a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1317, tv_nsec: 751468218 } })
48132024-09-03T23:55:39.250ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
48142024-09-03T23:55:39.250ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 5.689183ms iteration = 5 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
48152024-09-03T23:55:39.250ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 9 reason = Timeout
48162024-09-03T23:55:39.250ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
48172024-09-03T23:55:39.250ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 5 reason = Timeout
48182024-09-03T23:55:39.250ZINFOnexus (BackgroundTasks): Abandoned VMM reaper running background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:76
48192024-09-03T23:55:39.250ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
48202024-09-03T23:55:39.250ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 5 reason = Timeout
48212024-09-03T23:55:39.250ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 9 reason = Timeout
48222024-09-03T23:55:39.250ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 9 reason = Timeout
48232024-09-03T23:55:39.250ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
48242024-09-03T23:55:39.250ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
48252024-09-03T23:55:39.250ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 9 reason = Timeout
48262024-09-03T23:55:39.250ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
48272024-09-03T23:55:39.250ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
48282024-09-03T23:55:39.250ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
48292024-09-03T23:55:39.250ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 9 reason = Timeout
48302024-09-03T23:55:39.250ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
48312024-09-03T23:55:39.250ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 9 reason = Timeout
48322024-09-03T23:55:39.250ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
48332024-09-03T23:55:39.250ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 25 reason = Timeout
48342024-09-03T23:55:39.250ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48352024-09-03T23:55:39.250ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 9 reason = Timeout
48362024-09-03T23:55:39.250ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48372024-09-03T23:55:39.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
48382024-09-03T23:55:39.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
48392024-09-03T23:55:39.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
48402024-09-03T23:55:39.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
48412024-09-03T23:55:39.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
48422024-09-03T23:55:39.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
48432024-09-03T23:55:39.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
48442024-09-03T23:55:39.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
48452024-09-03T23:55:39.251ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
48462024-09-03T23:55:39.251ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
48472024-09-03T23:55:39.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48482024-09-03T23:55:39.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48492024-09-03T23:55:39.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
48502024-09-03T23:55:39.251ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
48512024-09-03T23:55:39.251ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
48522024-09-03T23:55:39.251ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
48532024-09-03T23:55:39.251ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b281022b-35b2-452e-ad2b-78e12f6ca16a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b281022b-35b2-452e-ad2b-78e12f6ca16a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1317, tv_nsec: 753287527 } })
48542024-09-03T23:55:39.251ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48552024-09-03T23:55:39.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48562024-09-03T23:55:39.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
48572024-09-03T23:55:39.252ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
48582024-09-03T23:55:39.253ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48592024-09-03T23:55:39.254ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48602024-09-03T23:55:39.256ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
48612024-09-03T23:55:39.256ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
48622024-09-03T23:55:39.256ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48632024-09-03T23:55:39.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
48642024-09-03T23:55:39.256ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48652024-09-03T23:55:39.257ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
48662024-09-03T23:55:39.257ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48672024-09-03T23:55:39.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48682024-09-03T23:55:39.258ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
48692024-09-03T23:55:39.258ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
48702024-09-03T23:55:39.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
48712024-09-03T23:55:39.259ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
48722024-09-03T23:55:39.259ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48732024-09-03T23:55:39.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48742024-09-03T23:55:39.259ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48752024-09-03T23:55:39.262ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
48762024-09-03T23:55:39.263ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 12.54505ms iteration = 5 status = {"errors":[],"found_port_ok":[]}
48772024-09-03T23:55:39.266ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48782024-09-03T23:55:39.268ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
48792024-09-03T23:55:39.268ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48802024-09-03T23:55:39.268ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48812024-09-03T23:55:39.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48822024-09-03T23:55:39.268ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
48832024-09-03T23:55:39.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
48842024-09-03T23:55:39.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
48852024-09-03T23:55:39.270ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48862024-09-03T23:55:39.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48872024-09-03T23:55:39.271ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
48882024-09-03T23:55:39.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
48892024-09-03T23:55:39.272ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48902024-09-03T23:55:39.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48912024-09-03T23:55:39.274ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48922024-09-03T23:55:39.277ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
48932024-09-03T23:55:39.277ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48942024-09-03T23:55:39.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48952024-09-03T23:55:39.278ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48962024-09-03T23:55:39.280ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b281022b-35b2-452e-ad2b-78e12f6ca16a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b281022b-35b2-452e-ad2b-78e12f6ca16a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1317, tv_nsec: 781542706 } })
48972024-09-03T23:55:39.282ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df
48982024-09-03T23:55:39.282ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48992024-09-03T23:55:39.282ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b1196b3e-aa3c-4486-a0ad-52f372819a8f, lookup_type: ById(b1196b3e-aa3c-4486-a0ad-52f372819a8f) } result = Ok(())
49002024-09-03T23:55:39.282ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49012024-09-03T23:55:39.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49022024-09-03T23:55:39.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49032024-09-03T23:55:39.293ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 42.624948ms iteration = 9 status = {"errors":[],"garbage_collect_requested":[]}
49042024-09-03T23:55:39.300ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
49052024-09-03T23:55:39.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
49062024-09-03T23:55:39.302ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
49072024-09-03T23:55:39.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
49082024-09-03T23:55:39.302ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49092024-09-03T23:55:39.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49102024-09-03T23:55:39.306ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:56
49112024-09-03T23:55:39.306ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
49122024-09-03T23:55:39.306ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
49132024-09-03T23:55:39.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
49142024-09-03T23:55:39.308ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 57.776674ms iteration = 9 status = {"errors":[],"records_set_to_done":[]}
49152024-09-03T23:55:39.310ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49162024-09-03T23:55:39.312ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
49172024-09-03T23:55:39.312ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
49182024-09-03T23:55:39.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
49192024-09-03T23:55:39.313ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b1196b3e-aa3c-4486-a0ad-52f372819a8f original_time_created = 2024-09-03 23:51:19.204380 UTC target_id = b1196b3e-aa3c-4486-a0ad-52f372819a8f time_created = 2024-09-03 23:51:19.204380 UTC
49202024-09-03T23:55:39.313ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 68.917314ms iteration = 25 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b1196b3e-aa3c-4486-a0ad-52f372819a8f","time_created":"2024-09-03T23:51:19.204380Z"}
49212024-09-03T23:55:39.316ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
49222024-09-03T23:55:39.316ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
49232024-09-03T23:55:39.316ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
49242024-09-03T23:55:39.316ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
49252024-09-03T23:55:39.316ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
49262024-09-03T23:55:39.316ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
49272024-09-03T23:55:39.316ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 66.026062ms iteration = 5 status = {"error":null,"error_count":0,"found":0,"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0}
49282024-09-03T23:55:39.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
49292024-09-03T23:55:39.316ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49302024-09-03T23:55:39.317ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49312024-09-03T23:55:39.318ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
49322024-09-03T23:55:39.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
49332024-09-03T23:55:39.319ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
49342024-09-03T23:55:39.319ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
49352024-09-03T23:55:39.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
49362024-09-03T23:55:39.320ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49372024-09-03T23:55:39.322ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
49382024-09-03T23:55:39.324ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
49392024-09-03T23:55:39.324ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
49402024-09-03T23:55:39.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
49412024-09-03T23:55:39.327ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49422024-09-03T23:55:39.329ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
49432024-09-03T23:55:39.329ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
49442024-09-03T23:55:39.329ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
49452024-09-03T23:55:39.331ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
49462024-09-03T23:55:39.331ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
49472024-09-03T23:55:39.331ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 84.799907ms iteration = 5 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
49482024-09-03T23:55:39.342ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49492024-09-03T23:55:39.344ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
49502024-09-03T23:55:39.344ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
49512024-09-03T23:55:39.344ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49522024-09-03T23:55:39.345ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 101.131687ms iteration = 9 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
49532024-09-03T23:55:39.350ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 103.440028ms iteration = 9 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
49542024-09-03T23:55:39.350ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:56
49552024-09-03T23:55:39.350ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
49562024-09-03T23:55:39.350ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
49572024-09-03T23:55:39.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
49582024-09-03T23:55:39.354ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
49592024-09-03T23:55:39.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
49602024-09-03T23:55:39.356ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 105.651385ms iteration = 9 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
49612024-09-03T23:55:39.357ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 106.827601ms iteration = 9 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
49622024-09-03T23:55:39.357ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 107.334882ms iteration = 25 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
49632024-09-03T23:55:39.366ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
49642024-09-03T23:55:39.366ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
49652024-09-03T23:55:39.367ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:480 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
49662024-09-03T23:55:39.367ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 116.583281ms iteration = 9 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
49672024-09-03T23:55:39.368ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
49682024-09-03T23:55:39.368ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
49692024-09-03T23:55:39.368ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
49702024-09-03T23:55:39.368ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
49712024-09-03T23:55:39.368ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
49722024-09-03T23:55:39.368ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
49732024-09-03T23:55:39.368ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 3d837478-6c27-4614-b539-014b54fe9c3e dns_zone_name = oxide.test found_so_far = 0 version = 2
49742024-09-03T23:55:39.368ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
49752024-09-03T23:55:39.368ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49762024-09-03T23:55:39.368ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
49772024-09-03T23:55:39.370ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
49782024-09-03T23:55:39.370ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
49792024-09-03T23:55:39.370ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
49802024-09-03T23:55:39.371ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49812024-09-03T23:55:39.372ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49822024-09-03T23:55:39.372ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49832024-09-03T23:55:39.374ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
49842024-09-03T23:55:39.374ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
49852024-09-03T23:55:39.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49862024-09-03T23:55:39.375ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
49872024-09-03T23:55:39.375ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
49882024-09-03T23:55:39.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
49892024-09-03T23:55:39.375ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
49902024-09-03T23:55:39.375ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
49912024-09-03T23:55:39.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
49922024-09-03T23:55:39.387ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:56
49932024-09-03T23:55:39.387ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:241 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
49942024-09-03T23:55:39.387ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 136.677173ms iteration = 9 status = {"destroyed_active_vmms":0,"error":null,"failed_active_vmms":0,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
49952024-09-03T23:55:39.401ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
49962024-09-03T23:55:39.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49972024-09-03T23:55:39.403ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-09-03T23:51:37.486746Z, time_modified: 2024-09-03T23:51:37.486746Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 8448d8a2-33e4-4746-ac02-db97b8df3ca4, db_silo: Silo { identity: SiloIdentity { id: 8448d8a2-33e4-4746-ac02-db97b8df3ca4, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-09-03T23:51:42.648012Z, time_modified: 2024-09-03T23:51:42.648012Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "294cc86510f94c68a456b8ade6786c3fe5efad002008ff9982b0149d3f4d8d7a" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 8448d8a2-33e4-4746-ac02-db97b8df3ca4, db_silo: Silo { identity: SiloIdentity { id: 8448d8a2-33e4-4746-ac02-db97b8df3ca4, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-09-03T23:51:42.648012Z, time_modified: 2024-09-03T23:51:42.648012Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "294cc86510f94c68a456b8ade6786c3fe5efad002008ff9982b0149d3f4d8d7a" }] }) }
49982024-09-03T23:55:39.403ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 158.687998ms iteration = 5 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"8448d8a2-33e4-4746-ac02-db97b8df3ca4","tls_certs":["294cc86510f94c68a456b8ade6786c3fe5efad002008ff9982b0149d3f4d8d7a"]}},"default_endpoint":{"silo_id":"8448d8a2-33e4-4746-ac02-db97b8df3ca4","tls_certs":["294cc86510f94c68a456b8ade6786c3fe5efad002008ff9982b0149d3f4d8d7a"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
49992024-09-03T23:55:39.415ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
50002024-09-03T23:55:39.415ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
50012024-09-03T23:55:39.415ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "cd1c669a-2bc5-495b-948d-fc5fe4ab71b8", "content-length": "26", "date": "Tue, 03 Sep 2024 23:55:39 GMT"} })
50022024-09-03T23:55:39.415ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
50032024-09-03T23:55:39.417ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
50042024-09-03T23:55:39.419ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 172.676928ms iteration = 11 status = {"physical_disks_added":0}
50052024-09-03T23:55:39.423ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
50062024-09-03T23:55:39.423ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
50072024-09-03T23:55:39.423ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "91d51b88-2156-46a8-9c06-5586ea31d239", "content-length": "26", "date": "Tue, 03 Sep 2024 23:55:39 GMT"} })
50082024-09-03T23:55:39.423ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
50092024-09-03T23:55:39.424ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
50102024-09-03T23:55:39.511ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = a6177b32-9d68-4631-b102-0cb066e4b2fd roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
50112024-09-03T23:55:39.511ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = a6177b32-9d68-4631-b102-0cb066e4b2fd resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
50122024-09-03T23:55:39.581ZDEBGnexus (BackgroundTasks): client request SledAgent = b281022b-35b2-452e-ad2b-78e12f6ca16a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
50132024-09-03T23:55:39.582ZDEBGnexus (BackgroundTasks): client response SledAgent = b281022b-35b2-452e-ad2b-78e12f6ca16a background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "cdfb3a66-2ae6-471a-b6c7-4164e9404d30", "content-length": "372", "date": "Tue, 03 Sep 2024 23:55:39 GMT"} })
50142024-09-03T23:55:39.582ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50152024-09-03T23:55:39.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50162024-09-03T23:55:39.585ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 3d837478-6c27-4614-b539-014b54fe9c3e dns_zone_name = oxide.test found_so_far = 1 version = 2
50172024-09-03T23:55:39.585ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
50182024-09-03T23:55:39.585ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-09-03 23:51:42.685737 UTC dns_group = external generation = 2
50192024-09-03T23:55:39.585ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 341.042355ms iteration = 5 status = {"generation":2}
50202024-09-03T23:55:39.586ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 75147 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = a6177b32-9d68-4631-b102-0cb066e4b2fd response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
50212024-09-03T23:55:39.586ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50222024-09-03T23:55:39.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50232024-09-03T23:55:39.587ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50242024-09-03T23:55:39.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50252024-09-03T23:55:39.588ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50262024-09-03T23:55:39.591ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: b281022b-35b2-452e-ad2b-78e12f6ca16a, lookup_type: ById(b281022b-35b2-452e-ad2b-78e12f6ca16a) } result = Ok(())
50272024-09-03T23:55:39.591ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50282024-09-03T23:55:39.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50292024-09-03T23:55:39.611ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
50302024-09-03T23:55:39.615ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
50312024-09-03T23:55:39.615ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 35395b13-f2fe-45cc-ba7e-90fa45dea705 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
50322024-09-03T23:55:39.615ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
50332024-09-03T23:55:39.616ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
50342024-09-03T23:55:39.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
50352024-09-03T23:55:39.616ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "37913d9e-66d5-4831-9384-4b54e978930c", "content-length": "1", "date": "Tue, 03 Sep 2024 23:55:39 GMT"} })
50362024-09-03T23:55:39.618ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
50372024-09-03T23:55:39.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
50382024-09-03T23:55:39.622ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 377.52981ms iteration = 9 status = {}
50392024-09-03T23:55:39.623ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
50402024-09-03T23:55:39.689ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df zone_address = fd00:1122:3344:101::2
50412024-09-03T23:55:39.689ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
50422024-09-03T23:55:39.689ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "3c3ed364-068a-450b-a9e3-28cbc3390479", "content-length": "26", "date": "Tue, 03 Sep 2024 23:55:39 GMT"} })
50432024-09-03T23:55:39.689ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
50442024-09-03T23:55:39.691ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df
50452024-09-03T23:55:39.722ZDEBGnexus (BackgroundTasks): client request SledAgent = b281022b-35b2-452e-ad2b-78e12f6ca16a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
50462024-09-03T23:55:39.724ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 478.082936ms iteration = 9 status = 0
50472024-09-03T23:55:39.724ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 480.461307ms iteration = 9 status = null
50482024-09-03T23:55:39.725ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50492024-09-03T23:55:39.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50502024-09-03T23:55:39.729ZDEBGnexus (BackgroundTasks): client request SledAgent = b281022b-35b2-452e-ad2b-78e12f6ca16a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
50512024-09-03T23:55:39.756ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50522024-09-03T23:55:39.759ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
50532024-09-03T23:55:39.759ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
50542024-09-03T23:55:39.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
50552024-09-03T23:55:39.766ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 35395b13-f2fe-45cc-ba7e-90fa45dea705 dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
50562024-09-03T23:55:39.766ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
50572024-09-03T23:55:39.766ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-09-03 23:51:41.890432 UTC dns_group = internal generation = 1
50582024-09-03T23:55:39.766ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 521.868778ms iteration = 5 status = {"generation":1}
50592024-09-03T23:55:39.823ZDEBGnexus (BackgroundTasks): client response SledAgent = b281022b-35b2-452e-ad2b-78e12f6ca16a background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "c7de1b7a-14cf-4df6-9ea8-65273fdb5222", "date": "Tue, 03 Sep 2024 23:55:39 GMT"} })
50602024-09-03T23:55:39.825ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 574.424241ms iteration = 9 status = {}
50612024-09-03T23:55:39.825ZDEBGnexus (BackgroundTasks): client response SledAgent = b281022b-35b2-452e-ad2b-78e12f6ca16a background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f210465f-171e-4e7a-be36-7b4b99f22776", "content-length": "691", "date": "Tue, 03 Sep 2024 23:55:39 GMT"} })
50622024-09-03T23:55:39.825ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
50632024-09-03T23:55:39.825ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
50642024-09-03T23:55:39.825ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
50652024-09-03T23:55:39.826ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 579.876499ms iteration = 9 status = {}
50662024-09-03T23:55:39.832ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
50672024-09-03T23:55:39.880ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 464 local_addr = [fd00:1122:3344:101::c]:59395 method = GET remote_addr = [fd00:1122:3344:101::d]:55949 req_id = e637bc8e-9a9b-46ea-9f1b-5738dc501fb4 response_code = 200 uri = /5f5ce676-2064-4d97-b873-fbcbc29495de
50682024-09-03T23:55:39.884ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
50692024-09-03T23:55:39.885ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "245744ab-d996-4cca-b06a-c300270990bc", "date": "Tue, 03 Sep 2024 23:55:39 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
50702024-09-03T23:55:39.885ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
50712024-09-03T23:55:39.887ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "3dafc4e4-7025-4756-a1e2-e6fe37f691d2", "date": "Tue, 03 Sep 2024 23:55:39 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
50722024-09-03T23:55:39.887ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
50732024-09-03T23:55:39.888ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
50742024-09-03T23:55:39.888ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 644.058329ms iteration = 7 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
50752024-09-03T23:55:39.942ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
50762024-09-03T23:55:39.942ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "36053736-955d-4180-8532-5f2bc71391c8", "date": "Tue, 03 Sep 2024 23:55:39 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
50772024-09-03T23:55:39.942ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
50782024-09-03T23:55:39.944ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "1358ee16-f7d6-4684-b02b-a222d5505500", "date": "Tue, 03 Sep 2024 23:55:39 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
50792024-09-03T23:55:39.944ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
50802024-09-03T23:55:39.946ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "612c1020-9c01-4223-b8f6-62a77c565512", "date": "Tue, 03 Sep 2024 23:55:39 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
50812024-09-03T23:55:39.946ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
50822024-09-03T23:55:39.948ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
50832024-09-03T23:55:39.948ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 703.834097ms iteration = 7 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
50842024-09-03T23:55:39.966ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50852024-09-03T23:55:39.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50862024-09-03T23:55:39.969ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: ec64e2ff-6fd0-4ab3-a8fa-a8a710b73297, rack_id: 1d4636f4-828e-412a-8daf-3bda355c92df, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(ccbb015a-58a4-4f0f-8a1a-5716d0b9db06) } rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df switch_location = Switch0
50872024-09-03T23:55:39.969ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50882024-09-03T23:55:39.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50892024-09-03T23:55:39.978ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
50902024-09-03T23:55:39.979ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d0acf9a5-a10c-407e-aca9-6059c37867d5", "content-length": "121", "date": "Tue, 03 Sep 2024 23:55:39 GMT"} })
50912024-09-03T23:55:39.979ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
50922024-09-03T23:55:39.979ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = ccbb015a-58a4-4f0f-8a1a-5716d0b9db06
50932024-09-03T23:55:39.980ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
50942024-09-03T23:55:39.980ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
50952024-09-03T23:55:39.980ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df routes = {}
50962024-09-03T23:55:39.980ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df routes = {}
50972024-09-03T23:55:39.980ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df
50982024-09-03T23:55:39.980ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50992024-09-03T23:55:39.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51002024-09-03T23:55:39.982ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
51012024-09-03T23:55:39.982ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "4c014d75-ef46-4ccb-bca7-db37bcb0b385", "content-length": "2", "date": "Tue, 03 Sep 2024 23:55:39 GMT"} })
51022024-09-03T23:55:39.982ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
51032024-09-03T23:55:39.982ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "120d27f6-efe4-4b17-98b4-e3ef3bc3d28b", "content-length": "52", "date": "Tue, 03 Sep 2024 23:55:39 GMT"} })
51042024-09-03T23:55:39.982ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df switch_location = Switch0
51052024-09-03T23:55:39.982ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
51062024-09-03T23:55:40.080ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "4c198b02-2959-45e8-bd18-35ad35384d40", "date": "Tue, 03 Sep 2024 23:55:39 GMT"} })
51072024-09-03T23:55:40.080ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df switch = Switch0
51082024-09-03T23:55:40.080ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
51092024-09-03T23:55:40.080ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "305745c9-f01a-45b0-b60d-0a03ccb4dcbb", "content-length": "667", "date": "Tue, 03 Sep 2024 23:55:39 GMT"} })
51102024-09-03T23:55:40.081ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51112024-09-03T23:55:40.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51122024-09-03T23:55:40.084ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51132024-09-03T23:55:40.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51142024-09-03T23:55:40.088ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51152024-09-03T23:55:40.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51162024-09-03T23:55:40.090ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51172024-09-03T23:55:40.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51182024-09-03T23:55:40.097ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 850.992176ms iteration = 9 status = {}
51192024-09-03T23:55:40.565ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50060 req_id = 5ac6e710-6a9c-4288-9015-64213dfbe1d0 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
51202024-09-03T23:55:40.566ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50060 req_id = 5ac6e710-6a9c-4288-9015-64213dfbe1d0 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
51212024-09-03T23:55:40.569ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3504 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50060 req_id = 5ac6e710-6a9c-4288-9015-64213dfbe1d0 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
51222024-09-03T23:55:40.610ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 48275431-37a6-4ab3-bb6d-fba746e14d4c roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
51232024-09-03T23:55:40.610ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 48275431-37a6-4ab3-bb6d-fba746e14d4c resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
51242024-09-03T23:55:40.612ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2981 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 48275431-37a6-4ab3-bb6d-fba746e14d4c response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
51252024-09-03T23:55:41.631ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 23fb6a82-ae12-42b3-8315-d8c839c14dfa roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
51262024-09-03T23:55:41.631ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 23fb6a82-ae12-42b3-8315-d8c839c14dfa resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
51272024-09-03T23:55:41.633ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2376 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 23fb6a82-ae12-42b3-8315-d8c839c14dfa response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
51282024-09-03T23:55:42.653ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = e9842620-46f4-47ef-9826-43909ccd6460 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
51292024-09-03T23:55:42.654ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = e9842620-46f4-47ef-9826-43909ccd6460 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
51302024-09-03T23:55:42.656ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2419 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = e9842620-46f4-47ef-9826-43909ccd6460 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
51312024-09-03T23:55:43.675ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 7fa91b7c-1ae6-45e3-ab6e-2c374da83cf5 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
51322024-09-03T23:55:43.675ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 7fa91b7c-1ae6-45e3-ab6e-2c374da83cf5 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
51332024-09-03T23:55:43.679ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 4348 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 7fa91b7c-1ae6-45e3-ab6e-2c374da83cf5 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
51342024-09-03T23:55:44.699ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 9848ce30-097c-4a44-902d-dabca934bb7c roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
51352024-09-03T23:55:44.699ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 9848ce30-097c-4a44-902d-dabca934bb7c resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
51362024-09-03T23:55:44.702ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2654 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 9848ce30-097c-4a44-902d-dabca934bb7c response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
51372024-09-03T23:55:45.721ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 0853efd2-b663-4a2d-b793-e0314264f5e7 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
51382024-09-03T23:55:45.721ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 0853efd2-b663-4a2d-b793-e0314264f5e7 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
51392024-09-03T23:55:45.723ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2287 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 0853efd2-b663-4a2d-b793-e0314264f5e7 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
51402024-09-03T23:55:46.742ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = b151cab1-dd75-49c7-af48-1372542532dc roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
51412024-09-03T23:55:46.743ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = b151cab1-dd75-49c7-af48-1372542532dc resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
51422024-09-03T23:55:46.744ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1991 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = b151cab1-dd75-49c7-af48-1372542532dc response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
51432024-09-03T23:55:47.764ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = ad9daa74-4d2f-419e-83e5-2f9cb3e71242 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
51442024-09-03T23:55:47.764ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = ad9daa74-4d2f-419e-83e5-2f9cb3e71242 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
51452024-09-03T23:55:47.766ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2375 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = ad9daa74-4d2f-419e-83e5-2f9cb3e71242 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
51462024-09-03T23:55:48.789ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 4a992b6b-ce7f-48ac-a6c6-65b03ae313d7 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
51472024-09-03T23:55:48.789ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 4a992b6b-ce7f-48ac-a6c6-65b03ae313d7 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
51482024-09-03T23:55:48.791ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1879 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 4a992b6b-ce7f-48ac-a6c6-65b03ae313d7 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
51492024-09-03T23:55:49.244ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 26 reason = Timeout
51502024-09-03T23:55:49.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51512024-09-03T23:55:49.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51522024-09-03T23:55:49.251ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 26 reason = Timeout
51532024-09-03T23:55:49.251ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
51542024-09-03T23:55:49.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
51552024-09-03T23:55:49.271ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51562024-09-03T23:55:49.274ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
51572024-09-03T23:55:49.274ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51582024-09-03T23:55:49.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51592024-09-03T23:55:49.276ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51602024-09-03T23:55:49.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51612024-09-03T23:55:49.276ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
51622024-09-03T23:55:49.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
51632024-09-03T23:55:49.303ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51642024-09-03T23:55:49.303ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 52.105332ms iteration = 26 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
51652024-09-03T23:55:49.305ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b1196b3e-aa3c-4486-a0ad-52f372819a8f, lookup_type: ById(b1196b3e-aa3c-4486-a0ad-52f372819a8f) } result = Ok(())
51662024-09-03T23:55:49.305ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51672024-09-03T23:55:49.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51682024-09-03T23:55:49.312ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b1196b3e-aa3c-4486-a0ad-52f372819a8f original_time_created = 2024-09-03 23:51:19.204380 UTC target_id = b1196b3e-aa3c-4486-a0ad-52f372819a8f time_created = 2024-09-03 23:51:19.204380 UTC
51692024-09-03T23:55:49.312ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 68.043805ms iteration = 26 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b1196b3e-aa3c-4486-a0ad-52f372819a8f","time_created":"2024-09-03T23:51:19.204380Z"}
51702024-09-03T23:55:49.811ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 15d9cc81-865a-4cd2-83da-ad4854d5b12d roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
51712024-09-03T23:55:49.811ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 15d9cc81-865a-4cd2-83da-ad4854d5b12d resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
51722024-09-03T23:55:49.812ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1963 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 15d9cc81-865a-4cd2-83da-ad4854d5b12d response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
51732024-09-03T23:55:49.879ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 421 local_addr = [fd00:1122:3344:101::c]:59395 method = GET remote_addr = [fd00:1122:3344:101::d]:55949 req_id = 23cf06ee-7866-44ee-a20c-cb4d550e27e1 response_code = 200 uri = /5f5ce676-2064-4d97-b873-fbcbc29495de
51742024-09-03T23:55:50.833ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 9af0f247-9824-45a5-b76f-1302454d4104 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
51752024-09-03T23:55:50.833ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 9af0f247-9824-45a5-b76f-1302454d4104 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
51762024-09-03T23:55:50.835ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2251 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 9af0f247-9824-45a5-b76f-1302454d4104 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
51772024-09-03T23:55:51.855ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = e5eb85d2-cd12-412a-8967-17acf5cfc955 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
51782024-09-03T23:55:51.856ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = e5eb85d2-cd12-412a-8967-17acf5cfc955 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
51792024-09-03T23:55:51.858ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2302 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = e5eb85d2-cd12-412a-8967-17acf5cfc955 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
51802024-09-03T23:55:52.881ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 76f22f43-3678-4c76-a0aa-c8afb41e528f roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
51812024-09-03T23:55:52.882ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 76f22f43-3678-4c76-a0aa-c8afb41e528f resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
51822024-09-03T23:55:52.883ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1710 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 76f22f43-3678-4c76-a0aa-c8afb41e528f response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
51832024-09-03T23:55:53.903ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 24761c41-6cc3-4c66-9ebc-ab713cc9e471 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
51842024-09-03T23:55:53.903ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 24761c41-6cc3-4c66-9ebc-ab713cc9e471 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
51852024-09-03T23:55:53.904ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2216 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 24761c41-6cc3-4c66-9ebc-ab713cc9e471 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
51862024-09-03T23:55:54.924ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 3851ceda-201b-47f1-9d82-86d6994c7e1d roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
51872024-09-03T23:55:54.924ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 3851ceda-201b-47f1-9d82-86d6994c7e1d resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
51882024-09-03T23:55:54.926ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2118 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 3851ceda-201b-47f1-9d82-86d6994c7e1d response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
51892024-09-03T23:55:55.945ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 9320efbf-b250-484f-9e31-aa857ecc65e5 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
51902024-09-03T23:55:55.945ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 9320efbf-b250-484f-9e31-aa857ecc65e5 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
51912024-09-03T23:55:55.947ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2432 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 9320efbf-b250-484f-9e31-aa857ecc65e5 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
51922024-09-03T23:55:56.967ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 6cdf6a97-5434-4370-b3d0-63e1804209b5 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
51932024-09-03T23:55:56.968ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 6cdf6a97-5434-4370-b3d0-63e1804209b5 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
51942024-09-03T23:55:56.969ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2400 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 6cdf6a97-5434-4370-b3d0-63e1804209b5 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
51952024-09-03T23:55:57.988ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 073ce2ec-be3a-4c7d-b334-14991d4fc11b roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
51962024-09-03T23:55:57.989ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 073ce2ec-be3a-4c7d-b334-14991d4fc11b resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
51972024-09-03T23:55:57.990ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2069 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 073ce2ec-be3a-4c7d-b334-14991d4fc11b response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
51982024-09-03T23:55:59.010ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 64ac498e-9752-4847-80a9-83d544a12682 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
51992024-09-03T23:55:59.011ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 64ac498e-9752-4847-80a9-83d544a12682 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
52002024-09-03T23:55:59.012ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2221 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 64ac498e-9752-4847-80a9-83d544a12682 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
52012024-09-03T23:55:59.245ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 27 reason = Timeout
52022024-09-03T23:55:59.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52032024-09-03T23:55:59.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52042024-09-03T23:55:59.247ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52052024-09-03T23:55:59.250ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
52062024-09-03T23:55:59.250ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52072024-09-03T23:55:59.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52082024-09-03T23:55:59.250ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 27 reason = Timeout
52092024-09-03T23:55:59.250ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52102024-09-03T23:55:59.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52112024-09-03T23:55:59.251ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52122024-09-03T23:55:59.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52132024-09-03T23:55:59.253ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52142024-09-03T23:55:59.255ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b1196b3e-aa3c-4486-a0ad-52f372819a8f, lookup_type: ById(b1196b3e-aa3c-4486-a0ad-52f372819a8f) } result = Ok(())
52152024-09-03T23:55:59.255ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52162024-09-03T23:55:59.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52172024-09-03T23:55:59.265ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b1196b3e-aa3c-4486-a0ad-52f372819a8f original_time_created = 2024-09-03 23:51:19.204380 UTC target_id = b1196b3e-aa3c-4486-a0ad-52f372819a8f time_created = 2024-09-03 23:51:19.204380 UTC
52182024-09-03T23:55:59.265ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.992221ms iteration = 27 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b1196b3e-aa3c-4486-a0ad-52f372819a8f","time_created":"2024-09-03T23:51:19.204380Z"}
52192024-09-03T23:55:59.282ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52202024-09-03T23:55:59.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52212024-09-03T23:55:59.284ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 34.080053ms iteration = 27 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
52222024-09-03T23:55:59.879ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 478 local_addr = [fd00:1122:3344:101::c]:59395 method = GET remote_addr = [fd00:1122:3344:101::d]:55949 req_id = 98558878-9d93-4fd0-9518-343dc0311f5e response_code = 200 uri = /5f5ce676-2064-4d97-b873-fbcbc29495de
52232024-09-03T23:56:00.032ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = e8626e47-53fa-4110-94b5-e6a1ae4ecbc4 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
52242024-09-03T23:56:00.033ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = e8626e47-53fa-4110-94b5-e6a1ae4ecbc4 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
52252024-09-03T23:56:00.034ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2472 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = e8626e47-53fa-4110-94b5-e6a1ae4ecbc4 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
52262024-09-03T23:56:01.053ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 75ff198c-8e22-46a1-99a2-a9712da4ee46 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
52272024-09-03T23:56:01.054ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 75ff198c-8e22-46a1-99a2-a9712da4ee46 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
52282024-09-03T23:56:01.055ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1791 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 75ff198c-8e22-46a1-99a2-a9712da4ee46 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
52292024-09-03T23:56:02.075ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 019d7c59-9d7b-4be1-b7e6-1b41ba2a4669 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
52302024-09-03T23:56:02.076ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 019d7c59-9d7b-4be1-b7e6-1b41ba2a4669 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
52312024-09-03T23:56:02.077ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2436 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 019d7c59-9d7b-4be1-b7e6-1b41ba2a4669 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
52322024-09-03T23:56:03.097ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 965c534e-9392-42cb-9819-2f51092b00b0 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
52332024-09-03T23:56:03.098ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 965c534e-9392-42cb-9819-2f51092b00b0 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
52342024-09-03T23:56:03.099ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2404 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 965c534e-9392-42cb-9819-2f51092b00b0 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
52352024-09-03T23:56:04.118ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 5abd1f18-d2ab-47e2-9ca3-cf41b7f7eddc roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
52362024-09-03T23:56:04.119ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 5abd1f18-d2ab-47e2-9ca3-cf41b7f7eddc resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
52372024-09-03T23:56:04.121ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2324 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 5abd1f18-d2ab-47e2-9ca3-cf41b7f7eddc response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
52382024-09-03T23:56:05.140ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 4a0fd844-308c-4a04-a6e4-502e00483bde roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
52392024-09-03T23:56:05.140ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 4a0fd844-308c-4a04-a6e4-502e00483bde resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
52402024-09-03T23:56:05.141ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1730 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 4a0fd844-308c-4a04-a6e4-502e00483bde response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
52412024-09-03T23:56:06.161ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = b03b3ec7-fd37-4378-8885-59cfbddf0d25 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
52422024-09-03T23:56:06.162ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = b03b3ec7-fd37-4378-8885-59cfbddf0d25 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
52432024-09-03T23:56:06.163ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2073 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = b03b3ec7-fd37-4378-8885-59cfbddf0d25 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
52442024-09-03T23:56:07.183ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = b7d29455-cc2d-423f-8985-81b53aaf1a8c roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
52452024-09-03T23:56:07.183ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = b7d29455-cc2d-423f-8985-81b53aaf1a8c resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
52462024-09-03T23:56:07.185ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1706 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = b7d29455-cc2d-423f-8985-81b53aaf1a8c response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
52472024-09-03T23:56:08.204ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = a78586de-a011-4326-9e78-e026606188fc roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
52482024-09-03T23:56:08.204ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = a78586de-a011-4326-9e78-e026606188fc resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
52492024-09-03T23:56:08.206ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2649 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = a78586de-a011-4326-9e78-e026606188fc response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
52502024-09-03T23:56:09.225ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = b0ff42a2-3c4a-4b02-bc91-c7606a12092b roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
52512024-09-03T23:56:09.225ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = b0ff42a2-3c4a-4b02-bc91-c7606a12092b resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
52522024-09-03T23:56:09.232ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 7003 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = b0ff42a2-3c4a-4b02-bc91-c7606a12092b response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
52532024-09-03T23:56:09.244ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 10 reason = Timeout
52542024-09-03T23:56:09.244ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 28 reason = Timeout
52552024-09-03T23:56:09.244ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 10 reason = Timeout
52562024-09-03T23:56:09.244ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 10 reason = Timeout
52572024-09-03T23:56:09.244ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52582024-09-03T23:56:09.244ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
52592024-09-03T23:56:09.244ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
52602024-09-03T23:56:09.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
52612024-09-03T23:56:09.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52622024-09-03T23:56:09.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
52632024-09-03T23:56:09.246ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 10 reason = Timeout
52642024-09-03T23:56:09.246ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 12 reason = Timeout
52652024-09-03T23:56:09.246ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 10 reason = Timeout
52662024-09-03T23:56:09.246ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
52672024-09-03T23:56:09.246ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52682024-09-03T23:56:09.246ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 10 reason = Timeout
52692024-09-03T23:56:09.246ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52702024-09-03T23:56:09.246ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
52712024-09-03T23:56:09.246ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 10 reason = Timeout
52722024-09-03T23:56:09.246ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
52732024-09-03T23:56:09.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
52742024-09-03T23:56:09.247ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52752024-09-03T23:56:09.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
52762024-09-03T23:56:09.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
52772024-09-03T23:56:09.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52782024-09-03T23:56:09.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
52792024-09-03T23:56:09.250ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
52802024-09-03T23:56:09.250ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52812024-09-03T23:56:09.250ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 10 reason = Timeout
52822024-09-03T23:56:09.250ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
52832024-09-03T23:56:09.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52842024-09-03T23:56:09.250ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 10 reason = Timeout
52852024-09-03T23:56:09.250ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
52862024-09-03T23:56:09.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
52872024-09-03T23:56:09.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
52882024-09-03T23:56:09.251ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 10 reason = Timeout
52892024-09-03T23:56:09.251ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
52902024-09-03T23:56:09.251ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 10 reason = Timeout
52912024-09-03T23:56:09.251ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
52922024-09-03T23:56:09.251ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
52932024-09-03T23:56:09.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
52942024-09-03T23:56:09.251ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 28 reason = Timeout
52952024-09-03T23:56:09.251ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 10 reason = Timeout
52962024-09-03T23:56:09.251ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52972024-09-03T23:56:09.251ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52982024-09-03T23:56:09.251ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 10 reason = Timeout
52992024-09-03T23:56:09.251ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
53002024-09-03T23:56:09.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
53012024-09-03T23:56:09.251ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 10 reason = Timeout
53022024-09-03T23:56:09.251ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
53032024-09-03T23:56:09.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53042024-09-03T23:56:09.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
53052024-09-03T23:56:09.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
53062024-09-03T23:56:09.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53072024-09-03T23:56:09.252ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b281022b-35b2-452e-ad2b-78e12f6ca16a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b281022b-35b2-452e-ad2b-78e12f6ca16a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1347, tv_nsec: 753315308 } })
53082024-09-03T23:56:09.252ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
53092024-09-03T23:56:09.253ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53102024-09-03T23:56:09.254ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53112024-09-03T23:56:09.254ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53122024-09-03T23:56:09.257ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
53132024-09-03T23:56:09.257ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
53142024-09-03T23:56:09.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
53152024-09-03T23:56:09.258ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 13.720886ms iteration = 10 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
53162024-09-03T23:56:09.258ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
53172024-09-03T23:56:09.258ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53182024-09-03T23:56:09.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53192024-09-03T23:56:09.258ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b281022b-35b2-452e-ad2b-78e12f6ca16a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b281022b-35b2-452e-ad2b-78e12f6ca16a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1347, tv_nsec: 760128835 } })
53202024-09-03T23:56:09.259ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
53212024-09-03T23:56:09.259ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53222024-09-03T23:56:09.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53232024-09-03T23:56:09.259ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
53242024-09-03T23:56:09.261ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53252024-09-03T23:56:09.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53262024-09-03T23:56:09.261ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53272024-09-03T23:56:09.263ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:56
53282024-09-03T23:56:09.263ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
53292024-09-03T23:56:09.263ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
53302024-09-03T23:56:09.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
53312024-09-03T23:56:09.264ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
53322024-09-03T23:56:09.264ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
53332024-09-03T23:56:09.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
53342024-09-03T23:56:09.267ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53352024-09-03T23:56:09.268ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
53362024-09-03T23:56:09.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
53372024-09-03T23:56:09.268ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53382024-09-03T23:56:09.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53392024-09-03T23:56:09.269ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b281022b-35b2-452e-ad2b-78e12f6ca16a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b281022b-35b2-452e-ad2b-78e12f6ca16a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1347, tv_nsec: 770672532 } })
53402024-09-03T23:56:09.270ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
53412024-09-03T23:56:09.270ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53422024-09-03T23:56:09.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53432024-09-03T23:56:09.272ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df
53442024-09-03T23:56:09.275ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53452024-09-03T23:56:09.279ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
53462024-09-03T23:56:09.279ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
53472024-09-03T23:56:09.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
53482024-09-03T23:56:09.296ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53492024-09-03T23:56:09.296ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53502024-09-03T23:56:09.298ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
53512024-09-03T23:56:09.299ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53522024-09-03T23:56:09.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
53532024-09-03T23:56:09.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53542024-09-03T23:56:09.300ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
53552024-09-03T23:56:09.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
53562024-09-03T23:56:09.301ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 54.505644ms iteration = 10 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
53572024-09-03T23:56:09.301ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53582024-09-03T23:56:09.304ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: b281022b-35b2-452e-ad2b-78e12f6ca16a, lookup_type: ById(b281022b-35b2-452e-ad2b-78e12f6ca16a) } result = Ok(())
53592024-09-03T23:56:09.304ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53602024-09-03T23:56:09.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53612024-09-03T23:56:09.308ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:56
53622024-09-03T23:56:09.308ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
53632024-09-03T23:56:09.308ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
53642024-09-03T23:56:09.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
53652024-09-03T23:56:09.310ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 59.694155ms iteration = 10 status = {"errors":[],"records_set_to_done":[]}
53662024-09-03T23:56:09.310ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 63.679881ms iteration = 10 status = 0
53672024-09-03T23:56:09.310ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53682024-09-03T23:56:09.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53692024-09-03T23:56:09.313ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 62.288522ms iteration = 10 status = {"errors":[],"garbage_collect_requested":[]}
53702024-09-03T23:56:09.314ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53712024-09-03T23:56:09.314ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53722024-09-03T23:56:09.316ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
53732024-09-03T23:56:09.316ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53742024-09-03T23:56:09.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53752024-09-03T23:56:09.317ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
53762024-09-03T23:56:09.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
53772024-09-03T23:56:09.318ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b1196b3e-aa3c-4486-a0ad-52f372819a8f, lookup_type: ById(b1196b3e-aa3c-4486-a0ad-52f372819a8f) } result = Ok(())
53782024-09-03T23:56:09.318ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53792024-09-03T23:56:09.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53802024-09-03T23:56:09.324ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
53812024-09-03T23:56:09.324ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
53822024-09-03T23:56:09.324ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "0b41bec2-82fc-4c25-84c7-4b3ee4b23d6d", "content-length": "26", "date": "Tue, 03 Sep 2024 23:56:09 GMT"} })
53832024-09-03T23:56:09.324ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
53842024-09-03T23:56:09.326ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
53852024-09-03T23:56:09.338ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b1196b3e-aa3c-4486-a0ad-52f372819a8f original_time_created = 2024-09-03 23:51:19.204380 UTC target_id = b1196b3e-aa3c-4486-a0ad-52f372819a8f time_created = 2024-09-03 23:51:19.204380 UTC
53862024-09-03T23:56:09.338ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 93.556645ms iteration = 28 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b1196b3e-aa3c-4486-a0ad-52f372819a8f","time_created":"2024-09-03T23:51:19.204380Z"}
53872024-09-03T23:56:09.352ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 100.923903ms iteration = 10 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
53882024-09-03T23:56:09.352ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 101.078847ms iteration = 28 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
53892024-09-03T23:56:09.352ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:56
53902024-09-03T23:56:09.352ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:241 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
53912024-09-03T23:56:09.352ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 101.402114ms iteration = 10 status = {"destroyed_active_vmms":0,"error":null,"failed_active_vmms":0,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
53922024-09-03T23:56:09.356ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
53932024-09-03T23:56:09.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
53942024-09-03T23:56:09.362ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
53952024-09-03T23:56:09.362ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
53962024-09-03T23:56:09.362ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b5824834-2a52-44cf-ad65-c46e9218f79c", "content-length": "26", "date": "Tue, 03 Sep 2024 23:56:09 GMT"} })
53972024-09-03T23:56:09.362ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
53982024-09-03T23:56:09.364ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
53992024-09-03T23:56:09.365ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df zone_address = fd00:1122:3344:101::2
54002024-09-03T23:56:09.365ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
54012024-09-03T23:56:09.365ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b426ddde-3f8d-4858-8e38-bd7601baf734", "content-length": "26", "date": "Tue, 03 Sep 2024 23:56:09 GMT"} })
54022024-09-03T23:56:09.365ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
54032024-09-03T23:56:09.367ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df
54042024-09-03T23:56:09.385ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:480 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
54052024-09-03T23:56:09.385ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 134.268881ms iteration = 10 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
54062024-09-03T23:56:09.385ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 138.418041ms iteration = 12 status = {"physical_disks_added":0}
54072024-09-03T23:56:09.385ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 134.258062ms iteration = 10 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
54082024-09-03T23:56:09.386ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
54092024-09-03T23:56:09.386ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
54102024-09-03T23:56:09.425ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
54112024-09-03T23:56:09.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
54122024-09-03T23:56:09.527ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
54132024-09-03T23:56:09.527ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "7d8f83c1-0ce9-4bb1-af1b-368ab12236d9", "content-length": "1", "date": "Tue, 03 Sep 2024 23:56:09 GMT"} })
54142024-09-03T23:56:09.528ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
54152024-09-03T23:56:09.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
54162024-09-03T23:56:09.555ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 310.936037ms iteration = 10 status = {}
54172024-09-03T23:56:09.578ZDEBGnexus (BackgroundTasks): client request SledAgent = b281022b-35b2-452e-ad2b-78e12f6ca16a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
54182024-09-03T23:56:09.579ZDEBGnexus (BackgroundTasks): client response SledAgent = b281022b-35b2-452e-ad2b-78e12f6ca16a background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f0aa8562-cdba-47e5-accb-50d07de7ea50", "content-length": "372", "date": "Tue, 03 Sep 2024 23:56:09 GMT"} })
54192024-09-03T23:56:09.579ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54202024-09-03T23:56:09.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54212024-09-03T23:56:09.580ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54222024-09-03T23:56:09.581ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 336.381204ms iteration = 10 status = null
54232024-09-03T23:56:09.581ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54242024-09-03T23:56:09.581ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
54252024-09-03T23:56:09.581ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
54262024-09-03T23:56:09.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
54272024-09-03T23:56:09.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54282024-09-03T23:56:09.583ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54292024-09-03T23:56:09.584ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54302024-09-03T23:56:09.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54312024-09-03T23:56:09.585ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
54322024-09-03T23:56:09.585ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
54332024-09-03T23:56:09.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
54342024-09-03T23:56:09.586ZDEBGnexus (BackgroundTasks): client request SledAgent = b281022b-35b2-452e-ad2b-78e12f6ca16a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
54352024-09-03T23:56:09.587ZDEBGnexus (BackgroundTasks): client response SledAgent = b281022b-35b2-452e-ad2b-78e12f6ca16a background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "b85a2e66-35ec-4c44-a30a-4f1696bf0023", "date": "Tue, 03 Sep 2024 23:56:09 GMT"} })
54362024-09-03T23:56:09.589ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 337.750574ms iteration = 10 status = {}
54372024-09-03T23:56:09.599ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50060 req_id = 260d2e69-5548-47cf-9ee1-2b96462cb18c roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
54382024-09-03T23:56:09.599ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50060 req_id = 260d2e69-5548-47cf-9ee1-2b96462cb18c resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
54392024-09-03T23:56:09.602ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3056 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50060 req_id = 260d2e69-5548-47cf-9ee1-2b96462cb18c response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
54402024-09-03T23:56:09.651ZDEBGnexus (BackgroundTasks): client request SledAgent = b281022b-35b2-452e-ad2b-78e12f6ca16a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
54412024-09-03T23:56:09.671ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54422024-09-03T23:56:09.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54432024-09-03T23:56:09.673ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: ec64e2ff-6fd0-4ab3-a8fa-a8a710b73297, rack_id: 1d4636f4-828e-412a-8daf-3bda355c92df, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(ccbb015a-58a4-4f0f-8a1a-5716d0b9db06) } rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df switch_location = Switch0
54442024-09-03T23:56:09.673ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54452024-09-03T23:56:09.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54462024-09-03T23:56:09.681ZDEBGnexus (BackgroundTasks): client response SledAgent = b281022b-35b2-452e-ad2b-78e12f6ca16a background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "8d8df06d-2613-408c-b745-376265429e29", "content-length": "691", "date": "Tue, 03 Sep 2024 23:56:09 GMT"} })
54472024-09-03T23:56:09.681ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
54482024-09-03T23:56:09.681ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
54492024-09-03T23:56:09.681ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
54502024-09-03T23:56:09.683ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
54512024-09-03T23:56:09.683ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 436.616363ms iteration = 10 status = {}
54522024-09-03T23:56:09.683ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "822c0651-4dc6-4271-a137-5c565dfdde85", "content-length": "121", "date": "Tue, 03 Sep 2024 23:56:09 GMT"} })
54532024-09-03T23:56:09.683ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
54542024-09-03T23:56:09.683ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = ccbb015a-58a4-4f0f-8a1a-5716d0b9db06
54552024-09-03T23:56:09.683ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
54562024-09-03T23:56:09.683ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
54572024-09-03T23:56:09.683ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df routes = {}
54582024-09-03T23:56:09.683ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df routes = {}
54592024-09-03T23:56:09.683ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df
54602024-09-03T23:56:09.683ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54612024-09-03T23:56:09.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54622024-09-03T23:56:09.686ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
54632024-09-03T23:56:09.687ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ebeea8b0-c1c6-439d-8591-87bea9323449", "content-length": "2", "date": "Tue, 03 Sep 2024 23:56:09 GMT"} })
54642024-09-03T23:56:09.687ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
54652024-09-03T23:56:09.687ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d183cdc9-7f3a-4103-91a1-435491bf647a", "content-length": "52", "date": "Tue, 03 Sep 2024 23:56:09 GMT"} })
54662024-09-03T23:56:09.687ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df switch_location = Switch0
54672024-09-03T23:56:09.687ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
54682024-09-03T23:56:09.802ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "1971a4b0-fdad-4a8f-aae1-44251e43bb8d", "date": "Tue, 03 Sep 2024 23:56:09 GMT"} })
54692024-09-03T23:56:09.802ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df switch = Switch0
54702024-09-03T23:56:09.802ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
54712024-09-03T23:56:09.802ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d89ee0ae-d594-49f8-a3b6-21410b153965", "content-length": "667", "date": "Tue, 03 Sep 2024 23:56:09 GMT"} })
54722024-09-03T23:56:09.802ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54732024-09-03T23:56:09.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54742024-09-03T23:56:09.807ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54752024-09-03T23:56:09.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54762024-09-03T23:56:09.811ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54772024-09-03T23:56:09.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54782024-09-03T23:56:09.814ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54792024-09-03T23:56:09.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54802024-09-03T23:56:09.822ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 575.313299ms iteration = 10 status = {}
54812024-09-03T23:56:09.880ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 457 local_addr = [fd00:1122:3344:101::c]:59395 method = GET remote_addr = [fd00:1122:3344:101::d]:55949 req_id = fcef6fa3-75e3-4deb-982b-a12010fe002b response_code = 200 uri = /5f5ce676-2064-4d97-b873-fbcbc29495de
54822024-09-03T23:56:10.262ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 3bb49800-5977-4b0c-b2e3-125d2d807e31 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
54832024-09-03T23:56:10.262ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 3bb49800-5977-4b0c-b2e3-125d2d807e31 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
54842024-09-03T23:56:10.264ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2295 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 3bb49800-5977-4b0c-b2e3-125d2d807e31 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
54852024-09-03T23:56:11.283ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = b2accf7d-2659-4b06-8a6e-bfaeeeb6cb4e roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
54862024-09-03T23:56:11.284ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = b2accf7d-2659-4b06-8a6e-bfaeeeb6cb4e resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
54872024-09-03T23:56:11.285ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2026 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = b2accf7d-2659-4b06-8a6e-bfaeeeb6cb4e response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
54882024-09-03T23:56:12.305ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = ad7cf803-0fa1-4903-8b3b-19097f29e36d roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
54892024-09-03T23:56:12.305ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = ad7cf803-0fa1-4903-8b3b-19097f29e36d resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
54902024-09-03T23:56:12.307ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2409 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = ad7cf803-0fa1-4903-8b3b-19097f29e36d response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
54912024-09-03T23:56:13.326ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 9784947f-0ee2-4295-9976-6d02fdcc7386 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
54922024-09-03T23:56:13.326ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 9784947f-0ee2-4295-9976-6d02fdcc7386 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
54932024-09-03T23:56:13.328ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2478 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 9784947f-0ee2-4295-9976-6d02fdcc7386 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
54942024-09-03T23:56:14.348ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 26569213-a6b5-40b5-8919-c7016318e078 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
54952024-09-03T23:56:14.348ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 26569213-a6b5-40b5-8919-c7016318e078 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
54962024-09-03T23:56:14.349ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1769 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 26569213-a6b5-40b5-8919-c7016318e078 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
54972024-09-03T23:56:15.367ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 0267e1f4-e30a-4f5c-8adf-a803f7330c80 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
54982024-09-03T23:56:15.367ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 0267e1f4-e30a-4f5c-8adf-a803f7330c80 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
54992024-09-03T23:56:15.369ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2355 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 0267e1f4-e30a-4f5c-8adf-a803f7330c80 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
55002024-09-03T23:56:16.388ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 38a7be67-4d2c-4b2c-8508-edbb71f4e42e roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
55012024-09-03T23:56:16.389ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 38a7be67-4d2c-4b2c-8508-edbb71f4e42e resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
55022024-09-03T23:56:16.390ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1859 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 38a7be67-4d2c-4b2c-8508-edbb71f4e42e response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
55032024-09-03T23:56:17.409ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = e55d78e2-6ea8-4b1c-9730-102868da590a roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
55042024-09-03T23:56:17.410ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = e55d78e2-6ea8-4b1c-9730-102868da590a resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
55052024-09-03T23:56:17.411ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2593 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = e55d78e2-6ea8-4b1c-9730-102868da590a response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
55062024-09-03T23:56:18.431ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 7fb9a9b9-55c5-46ad-9172-4342224404f7 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
55072024-09-03T23:56:18.431ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 7fb9a9b9-55c5-46ad-9172-4342224404f7 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
55082024-09-03T23:56:18.433ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2582 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 7fb9a9b9-55c5-46ad-9172-4342224404f7 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
55092024-09-03T23:56:19.244ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 29 reason = Timeout
55102024-09-03T23:56:19.244ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55112024-09-03T23:56:19.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55122024-09-03T23:56:19.246ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55132024-09-03T23:56:19.249ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
55142024-09-03T23:56:19.249ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55152024-09-03T23:56:19.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55162024-09-03T23:56:19.251ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55172024-09-03T23:56:19.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55182024-09-03T23:56:19.251ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 29 reason = Timeout
55192024-09-03T23:56:19.251ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
55202024-09-03T23:56:19.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
55212024-09-03T23:56:19.252ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55222024-09-03T23:56:19.255ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b1196b3e-aa3c-4486-a0ad-52f372819a8f, lookup_type: ById(b1196b3e-aa3c-4486-a0ad-52f372819a8f) } result = Ok(())
55232024-09-03T23:56:19.255ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55242024-09-03T23:56:19.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55252024-09-03T23:56:19.263ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b1196b3e-aa3c-4486-a0ad-52f372819a8f original_time_created = 2024-09-03 23:51:19.204380 UTC target_id = b1196b3e-aa3c-4486-a0ad-52f372819a8f time_created = 2024-09-03 23:51:19.204380 UTC
55262024-09-03T23:56:19.263ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.091651ms iteration = 29 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b1196b3e-aa3c-4486-a0ad-52f372819a8f","time_created":"2024-09-03T23:51:19.204380Z"}
55272024-09-03T23:56:19.283ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
55282024-09-03T23:56:19.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
55292024-09-03T23:56:19.285ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 34.051493ms iteration = 29 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
55302024-09-03T23:56:19.452ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 1b927163-6639-4a22-9324-77a5e5bdecbb roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
55312024-09-03T23:56:19.452ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 1b927163-6639-4a22-9324-77a5e5bdecbb resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
55322024-09-03T23:56:19.454ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1835 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 1b927163-6639-4a22-9324-77a5e5bdecbb response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
55332024-09-03T23:56:19.880ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 435 local_addr = [fd00:1122:3344:101::c]:59395 method = GET remote_addr = [fd00:1122:3344:101::d]:55949 req_id = 8c4379f2-1de2-427d-a9e3-91bcba1f8c8d response_code = 200 uri = /5f5ce676-2064-4d97-b873-fbcbc29495de
55342024-09-03T23:56:20.472ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 7f6b52ec-452c-4ab0-bc09-a814815b2346 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
55352024-09-03T23:56:20.472ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 7f6b52ec-452c-4ab0-bc09-a814815b2346 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
55362024-09-03T23:56:20.474ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1803 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 7f6b52ec-452c-4ab0-bc09-a814815b2346 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
55372024-09-03T23:56:21.494ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 34a73f19-688d-4a6d-a434-3abc95d65f0e roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
55382024-09-03T23:56:21.494ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 34a73f19-688d-4a6d-a434-3abc95d65f0e resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
55392024-09-03T23:56:21.496ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2860 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 34a73f19-688d-4a6d-a434-3abc95d65f0e response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
55402024-09-03T23:56:22.515ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 8cf19582-d408-49d1-bf54-91bda0d94995 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
55412024-09-03T23:56:22.516ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 8cf19582-d408-49d1-bf54-91bda0d94995 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
55422024-09-03T23:56:22.518ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2791 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 8cf19582-d408-49d1-bf54-91bda0d94995 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
55432024-09-03T23:56:23.537ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 3c493843-da1c-460e-bfad-f5dcae1e6bb6 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
55442024-09-03T23:56:23.537ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 3c493843-da1c-460e-bfad-f5dcae1e6bb6 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
55452024-09-03T23:56:23.539ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1977 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 3c493843-da1c-460e-bfad-f5dcae1e6bb6 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
55462024-09-03T23:56:24.557ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = eed85b0a-bdac-4036-af8f-b984a61da651 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
55472024-09-03T23:56:24.558ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = eed85b0a-bdac-4036-af8f-b984a61da651 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
55482024-09-03T23:56:24.559ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2231 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = eed85b0a-bdac-4036-af8f-b984a61da651 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
55492024-09-03T23:56:25.580ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = e0a55818-a350-4213-a6c2-24fb5056065b roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
55502024-09-03T23:56:25.580ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = e0a55818-a350-4213-a6c2-24fb5056065b resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
55512024-09-03T23:56:25.582ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2281 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = e0a55818-a350-4213-a6c2-24fb5056065b response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
55522024-09-03T23:56:26.604ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = d98e58b0-29c4-4c21-bcec-afa4e93955b4 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
55532024-09-03T23:56:26.604ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = d98e58b0-29c4-4c21-bcec-afa4e93955b4 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
55542024-09-03T23:56:26.606ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2400 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = d98e58b0-29c4-4c21-bcec-afa4e93955b4 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
55552024-09-03T23:56:27.628ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 96090677-a6f7-4768-ace7-1720bade619e roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
55562024-09-03T23:56:27.628ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 96090677-a6f7-4768-ace7-1720bade619e resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
55572024-09-03T23:56:27.630ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2488 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 96090677-a6f7-4768-ace7-1720bade619e response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
55582024-09-03T23:56:28.650ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = fff2ddf2-87c8-4658-885d-284c34fa66a1 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
55592024-09-03T23:56:28.650ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = fff2ddf2-87c8-4658-885d-284c34fa66a1 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
55602024-09-03T23:56:28.651ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1670 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = fff2ddf2-87c8-4658-885d-284c34fa66a1 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
55612024-09-03T23:56:29.244ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 30 reason = Timeout
55622024-09-03T23:56:29.244ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55632024-09-03T23:56:29.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55642024-09-03T23:56:29.246ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55652024-09-03T23:56:29.249ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
55662024-09-03T23:56:29.249ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55672024-09-03T23:56:29.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55682024-09-03T23:56:29.251ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55692024-09-03T23:56:29.251ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 30 reason = Timeout
55702024-09-03T23:56:29.251ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
55712024-09-03T23:56:29.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
55722024-09-03T23:56:29.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55732024-09-03T23:56:29.252ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
55742024-09-03T23:56:29.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
55752024-09-03T23:56:29.253ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55762024-09-03T23:56:29.254ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.073386ms iteration = 30 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
55772024-09-03T23:56:29.256ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b1196b3e-aa3c-4486-a0ad-52f372819a8f, lookup_type: ById(b1196b3e-aa3c-4486-a0ad-52f372819a8f) } result = Ok(())
55782024-09-03T23:56:29.256ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55792024-09-03T23:56:29.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55802024-09-03T23:56:29.262ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b1196b3e-aa3c-4486-a0ad-52f372819a8f original_time_created = 2024-09-03 23:51:19.204380 UTC target_id = b1196b3e-aa3c-4486-a0ad-52f372819a8f time_created = 2024-09-03 23:51:19.204380 UTC
55812024-09-03T23:56:29.262ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.743311ms iteration = 30 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b1196b3e-aa3c-4486-a0ad-52f372819a8f","time_created":"2024-09-03T23:51:19.204380Z"}
55822024-09-03T23:56:29.671ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = abb573c9-1bda-43f5-908e-14d8984b3393 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
55832024-09-03T23:56:29.672ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = abb573c9-1bda-43f5-908e-14d8984b3393 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
55842024-09-03T23:56:29.673ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1940 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = abb573c9-1bda-43f5-908e-14d8984b3393 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
55852024-09-03T23:56:29.880ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 432 local_addr = [fd00:1122:3344:101::c]:59395 method = GET remote_addr = [fd00:1122:3344:101::d]:55949 req_id = 60a0f47a-9443-4946-9fdf-4a9c5cabb6c6 response_code = 200 uri = /5f5ce676-2064-4d97-b873-fbcbc29495de
55862024-09-03T23:56:30.692ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 5db9ca20-edd8-43b3-97a6-fabda9001c5a roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
55872024-09-03T23:56:30.692ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 5db9ca20-edd8-43b3-97a6-fabda9001c5a resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
55882024-09-03T23:56:30.694ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1986 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 5db9ca20-edd8-43b3-97a6-fabda9001c5a response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
55892024-09-03T23:56:31.713ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 7cc5aa0d-d9be-4ed7-a84f-61736ff8fb9e roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
55902024-09-03T23:56:31.714ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 7cc5aa0d-d9be-4ed7-a84f-61736ff8fb9e resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
55912024-09-03T23:56:31.716ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2351 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 7cc5aa0d-d9be-4ed7-a84f-61736ff8fb9e response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
55922024-09-03T23:56:32.735ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 9164a546-1be2-425d-9eaf-7c0ce23766d3 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
55932024-09-03T23:56:32.735ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 9164a546-1be2-425d-9eaf-7c0ce23766d3 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
55942024-09-03T23:56:32.737ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1663 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 9164a546-1be2-425d-9eaf-7c0ce23766d3 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
55952024-09-03T23:56:33.755ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 5981f56d-3472-4a04-87d6-3891c2c996c4 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
55962024-09-03T23:56:33.755ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 5981f56d-3472-4a04-87d6-3891c2c996c4 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
55972024-09-03T23:56:33.758ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2613 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 5981f56d-3472-4a04-87d6-3891c2c996c4 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
55982024-09-03T23:56:34.776ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = db159a5e-fe10-4dab-bcb4-74351ae76d67 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
55992024-09-03T23:56:34.776ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = db159a5e-fe10-4dab-bcb4-74351ae76d67 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
56002024-09-03T23:56:34.778ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2379 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = db159a5e-fe10-4dab-bcb4-74351ae76d67 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
56012024-09-03T23:56:35.798ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = bfae8f48-9c23-47d4-9cf9-12a366e5e99a roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
56022024-09-03T23:56:35.798ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = bfae8f48-9c23-47d4-9cf9-12a366e5e99a resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
56032024-09-03T23:56:35.800ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1956 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = bfae8f48-9c23-47d4-9cf9-12a366e5e99a response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
56042024-09-03T23:56:36.819ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = ea2ebdb1-7153-4df9-847e-27163681db98 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
56052024-09-03T23:56:36.819ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = ea2ebdb1-7153-4df9-847e-27163681db98 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
56062024-09-03T23:56:36.821ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2399 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = ea2ebdb1-7153-4df9-847e-27163681db98 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
56072024-09-03T23:56:37.839ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 46d1066a-5390-4bf1-b3b6-0544cb09d60a roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
56082024-09-03T23:56:37.839ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 46d1066a-5390-4bf1-b3b6-0544cb09d60a resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
56092024-09-03T23:56:37.841ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1912 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 46d1066a-5390-4bf1-b3b6-0544cb09d60a response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
56102024-09-03T23:56:38.861ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 56d97518-55c4-42a7-a2f6-57904053dff2 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
56112024-09-03T23:56:38.862ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 56d97518-55c4-42a7-a2f6-57904053dff2 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
56122024-09-03T23:56:38.863ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1942 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 56d97518-55c4-42a7-a2f6-57904053dff2 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
56132024-09-03T23:56:39.244ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 8 reason = Timeout
56142024-09-03T23:56:39.245ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 31 reason = Timeout
56152024-09-03T23:56:39.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56162024-09-03T23:56:39.245ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 6 reason = Timeout
56172024-09-03T23:56:39.245ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 6 reason = Timeout
56182024-09-03T23:56:39.245ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-09-03 23:46:39.244992110 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
56192024-09-03T23:56:39.245ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
56202024-09-03T23:56:39.245ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 6 reason = Timeout
56212024-09-03T23:56:39.245ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 8 reason = Timeout
56222024-09-03T23:56:39.245ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 11 reason = Timeout
56232024-09-03T23:56:39.245ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 11 reason = Timeout
56242024-09-03T23:56:39.245ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
56252024-09-03T23:56:39.245ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 6 reason = Timeout
56262024-09-03T23:56:39.245ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
56272024-09-03T23:56:39.245ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 6 reason = Timeout
56282024-09-03T23:56:39.245ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
56292024-09-03T23:56:39.245ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 6 reason = Timeout
56302024-09-03T23:56:39.245ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
56312024-09-03T23:56:39.245ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
56322024-09-03T23:56:39.245ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
56332024-09-03T23:56:39.245ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 11 reason = Timeout
56342024-09-03T23:56:39.245ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
56352024-09-03T23:56:39.245ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 7 reason = Timeout
56362024-09-03T23:56:39.245ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = b1196b3e-aa3c-4486-a0ad-52f372819a8f
56372024-09-03T23:56:39.245ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 15.55\u{b5}s iteration = 7 status = {"enabled":false,"target_id":"b1196b3e-aa3c-4486-a0ad-52f372819a8f"}
56382024-09-03T23:56:39.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56392024-09-03T23:56:39.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
56402024-09-03T23:56:39.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
56412024-09-03T23:56:39.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
56422024-09-03T23:56:39.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
56432024-09-03T23:56:39.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
56442024-09-03T23:56:39.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
56452024-09-03T23:56:39.245ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1f2af9fb-1e02-483c-afd2-2b8742b46afd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("90a0c753-ce30-4bd3-a374-17c504cb8aee.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("90a0c753-ce30-4bd3-a374-17c504cb8aee.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1377, tv_nsec: 746822178 } })
56462024-09-03T23:56:39.246ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("321ab50f-2ef5-4620-bbd0-13eba6f06554.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("32795d59-c08e-49d2-b2b0-79f550835c9d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a7781486-6706-487a-a86f-e75908a89f03.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("a7781486-6706-487a-a86f-e75908a89f03.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1377, tv_nsec: 747056493 } })
56472024-09-03T23:56:39.247ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 11 reason = Timeout
56482024-09-03T23:56:39.247ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 11 reason = Timeout
56492024-09-03T23:56:39.247ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
56502024-09-03T23:56:39.247ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56512024-09-03T23:56:39.247ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 13 reason = Timeout
56522024-09-03T23:56:39.247ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 6 reason = Timeout
56532024-09-03T23:56:39.247ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
56542024-09-03T23:56:39.247ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 11 reason = Timeout
56552024-09-03T23:56:39.247ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
56562024-09-03T23:56:39.247ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
56572024-09-03T23:56:39.247ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
56582024-09-03T23:56:39.247ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 11 reason = Timeout
56592024-09-03T23:56:39.247ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
56602024-09-03T23:56:39.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
56612024-09-03T23:56:39.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56622024-09-03T23:56:39.247ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56632024-09-03T23:56:39.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
56642024-09-03T23:56:39.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
56652024-09-03T23:56:39.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
56662024-09-03T23:56:39.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
56672024-09-03T23:56:39.248ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
56682024-09-03T23:56:39.248ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
56692024-09-03T23:56:39.248ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 3.655049ms iteration = 6 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
56702024-09-03T23:56:39.248ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56712024-09-03T23:56:39.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
56722024-09-03T23:56:39.248ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
56732024-09-03T23:56:39.248ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 3.824422ms iteration = 6 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
56742024-09-03T23:56:39.249ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.906815ms iteration = 11 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
56752024-09-03T23:56:39.250ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b281022b-35b2-452e-ad2b-78e12f6ca16a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b281022b-35b2-452e-ad2b-78e12f6ca16a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1377, tv_nsec: 751385926 } })
56762024-09-03T23:56:39.250ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-09-03 23:46:39.244992110 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
56772024-09-03T23:56:39.250ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 5.502548ms iteration = 6 status = {"expiration":"2024-09-03T23:46:39.244992110Z","pruned":[]}
56782024-09-03T23:56:39.251ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
56792024-09-03T23:56:39.251ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56802024-09-03T23:56:39.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56812024-09-03T23:56:39.251ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 11 reason = Timeout
56822024-09-03T23:56:39.251ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56832024-09-03T23:56:39.251ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 31 reason = Timeout
56842024-09-03T23:56:39.251ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 6 reason = Timeout
56852024-09-03T23:56:39.251ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56862024-09-03T23:56:39.251ZINFOnexus (BackgroundTasks): Abandoned VMM reaper running background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:76
56872024-09-03T23:56:39.251ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
56882024-09-03T23:56:39.251ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 6 reason = Timeout
56892024-09-03T23:56:39.251ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
56902024-09-03T23:56:39.251ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 11 reason = Timeout
56912024-09-03T23:56:39.251ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
56922024-09-03T23:56:39.251ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 2 reason = Timeout
56932024-09-03T23:56:39.251ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
56942024-09-03T23:56:39.251ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
56952024-09-03T23:56:39.251ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 11 reason = Timeout
56962024-09-03T23:56:39.251ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
56972024-09-03T23:56:39.251ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
56982024-09-03T23:56:39.251ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 11 reason = Timeout
56992024-09-03T23:56:39.251ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 11 reason = Timeout
57002024-09-03T23:56:39.251ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
57012024-09-03T23:56:39.251ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
57022024-09-03T23:56:39.251ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 11 reason = Timeout
57032024-09-03T23:56:39.251ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
57042024-09-03T23:56:39.251ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 11 reason = Timeout
57052024-09-03T23:56:39.251ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
57062024-09-03T23:56:39.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57072024-09-03T23:56:39.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57082024-09-03T23:56:39.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
57092024-09-03T23:56:39.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
57102024-09-03T23:56:39.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
57112024-09-03T23:56:39.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
57122024-09-03T23:56:39.252ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
57132024-09-03T23:56:39.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
57142024-09-03T23:56:39.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
57152024-09-03T23:56:39.252ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
57162024-09-03T23:56:39.252ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
57172024-09-03T23:56:39.252ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
57182024-09-03T23:56:39.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
57192024-09-03T23:56:39.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
57202024-09-03T23:56:39.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
57212024-09-03T23:56:39.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
57222024-09-03T23:56:39.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
57232024-09-03T23:56:39.254ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b281022b-35b2-452e-ad2b-78e12f6ca16a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b281022b-35b2-452e-ad2b-78e12f6ca16a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1377, tv_nsec: 755756561 } })
57242024-09-03T23:56:39.254ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57252024-09-03T23:56:39.255ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57262024-09-03T23:56:39.256ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57272024-09-03T23:56:39.256ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57282024-09-03T23:56:39.256ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
57292024-09-03T23:56:39.257ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
57302024-09-03T23:56:39.257ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57312024-09-03T23:56:39.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57322024-09-03T23:56:39.258ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
57332024-09-03T23:56:39.258ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
57342024-09-03T23:56:39.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
57352024-09-03T23:56:39.259ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
57362024-09-03T23:56:39.259ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
57372024-09-03T23:56:39.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
57382024-09-03T23:56:39.260ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
57392024-09-03T23:56:39.260ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57402024-09-03T23:56:39.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
57412024-09-03T23:56:39.261ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57422024-09-03T23:56:39.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57432024-09-03T23:56:39.262ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57442024-09-03T23:56:39.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57452024-09-03T23:56:39.263ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 11.912997ms iteration = 6 status = {"errors":[],"found_port_ok":[]}
57462024-09-03T23:56:39.264ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
57472024-09-03T23:56:39.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
57482024-09-03T23:56:39.266ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57492024-09-03T23:56:39.268ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 16.74574ms iteration = 11 status = {"errors":[],"garbage_collect_requested":[]}
57502024-09-03T23:56:39.269ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
57512024-09-03T23:56:39.269ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
57522024-09-03T23:56:39.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
57532024-09-03T23:56:39.271ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57542024-09-03T23:56:39.271ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
57552024-09-03T23:56:39.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
57562024-09-03T23:56:39.273ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
57572024-09-03T23:56:39.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
57582024-09-03T23:56:39.273ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b281022b-35b2-452e-ad2b-78e12f6ca16a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b281022b-35b2-452e-ad2b-78e12f6ca16a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1377, tv_nsec: 774519294 } })
57592024-09-03T23:56:39.275ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df
57602024-09-03T23:56:39.275ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
57612024-09-03T23:56:39.277ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57622024-09-03T23:56:39.277ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57632024-09-03T23:56:39.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
57642024-09-03T23:56:39.279ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
57652024-09-03T23:56:39.279ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57662024-09-03T23:56:39.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
57672024-09-03T23:56:39.279ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b1196b3e-aa3c-4486-a0ad-52f372819a8f, lookup_type: ById(b1196b3e-aa3c-4486-a0ad-52f372819a8f) } result = Ok(())
57682024-09-03T23:56:39.280ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57692024-09-03T23:56:39.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57702024-09-03T23:56:39.283ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
57712024-09-03T23:56:39.283ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
57722024-09-03T23:56:39.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
57732024-09-03T23:56:39.286ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
57742024-09-03T23:56:39.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
57752024-09-03T23:56:39.296ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
57762024-09-03T23:56:39.296ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
57772024-09-03T23:56:39.298ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b1196b3e-aa3c-4486-a0ad-52f372819a8f original_time_created = 2024-09-03 23:51:19.204380 UTC target_id = b1196b3e-aa3c-4486-a0ad-52f372819a8f time_created = 2024-09-03 23:51:19.204380 UTC
57782024-09-03T23:56:39.298ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 53.532163ms iteration = 31 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b1196b3e-aa3c-4486-a0ad-52f372819a8f","time_created":"2024-09-03T23:51:19.204380Z"}
57792024-09-03T23:56:39.298ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
57802024-09-03T23:56:39.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
57812024-09-03T23:56:39.301ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
57822024-09-03T23:56:39.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
57832024-09-03T23:56:39.303ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57842024-09-03T23:56:39.306ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
57852024-09-03T23:56:39.306ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57862024-09-03T23:56:39.306ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
57872024-09-03T23:56:39.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57882024-09-03T23:56:39.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
57892024-09-03T23:56:39.308ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 56.282642ms iteration = 11 status = {"errors":[],"records_set_to_done":[]}
57902024-09-03T23:56:39.315ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57912024-09-03T23:56:39.318ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57922024-09-03T23:56:39.318ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
57932024-09-03T23:56:39.318ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
57942024-09-03T23:56:39.318ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 66.769468ms iteration = 6 status = {"error":null,"error_count":0,"found":0,"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0}
57952024-09-03T23:56:39.318ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
57962024-09-03T23:56:39.318ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57972024-09-03T23:56:39.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57982024-09-03T23:56:39.321ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57992024-09-03T23:56:39.321ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:56
58002024-09-03T23:56:39.321ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
58012024-09-03T23:56:39.321ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
58022024-09-03T23:56:39.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58032024-09-03T23:56:39.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
58042024-09-03T23:56:39.321ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58052024-09-03T23:56:39.322ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
58062024-09-03T23:56:39.324ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
58072024-09-03T23:56:39.324ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
58082024-09-03T23:56:39.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
58092024-09-03T23:56:39.325ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
58102024-09-03T23:56:39.325ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
58112024-09-03T23:56:39.326ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 74.366982ms iteration = 31 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
58122024-09-03T23:56:39.326ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
58132024-09-03T23:56:39.326ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
58142024-09-03T23:56:39.326ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
58152024-09-03T23:56:39.326ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
58162024-09-03T23:56:39.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
58172024-09-03T23:56:39.327ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
58182024-09-03T23:56:39.327ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
58192024-09-03T23:56:39.327ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 80.625926ms iteration = 6 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
58202024-09-03T23:56:39.328ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58212024-09-03T23:56:39.328ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:480 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
58222024-09-03T23:56:39.328ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 76.365865ms iteration = 11 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
58232024-09-03T23:56:39.328ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58242024-09-03T23:56:39.328ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 76.830495ms iteration = 11 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
58252024-09-03T23:56:39.329ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58262024-09-03T23:56:39.329ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58272024-09-03T23:56:39.329ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:56
58282024-09-03T23:56:39.329ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
58292024-09-03T23:56:39.329ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
58302024-09-03T23:56:39.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
58312024-09-03T23:56:39.333ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: b281022b-35b2-452e-ad2b-78e12f6ca16a, lookup_type: ById(b281022b-35b2-452e-ad2b-78e12f6ca16a) } result = Ok(())
58322024-09-03T23:56:39.333ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58332024-09-03T23:56:39.333ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
58342024-09-03T23:56:39.333ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
58352024-09-03T23:56:39.333ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58362024-09-03T23:56:39.333ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
58372024-09-03T23:56:39.335ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 88.192009ms iteration = 11 status = 0
58382024-09-03T23:56:39.336ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
58392024-09-03T23:56:39.336ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
58402024-09-03T23:56:39.337ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58412024-09-03T23:56:39.339ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
58422024-09-03T23:56:39.339ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
58432024-09-03T23:56:39.339ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
58442024-09-03T23:56:39.339ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
58452024-09-03T23:56:39.340ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
58462024-09-03T23:56:39.341ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58472024-09-03T23:56:39.344ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
58482024-09-03T23:56:39.344ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
58492024-09-03T23:56:39.344ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
58502024-09-03T23:56:39.352ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 104.856638ms iteration = 11 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
58512024-09-03T23:56:39.357ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
58522024-09-03T23:56:39.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
58532024-09-03T23:56:39.369ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
58542024-09-03T23:56:39.369ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
58552024-09-03T23:56:39.369ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
58562024-09-03T23:56:39.369ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
58572024-09-03T23:56:39.369ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
58582024-09-03T23:56:39.371ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58592024-09-03T23:56:39.374ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:56
58602024-09-03T23:56:39.374ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:241 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
58612024-09-03T23:56:39.374ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 122.745093ms iteration = 11 status = {"destroyed_active_vmms":0,"error":null,"failed_active_vmms":0,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
58622024-09-03T23:56:39.374ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
58632024-09-03T23:56:39.374ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
58642024-09-03T23:56:39.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
58652024-09-03T23:56:39.375ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
58662024-09-03T23:56:39.375ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 35395b13-f2fe-45cc-ba7e-90fa45dea705 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
58672024-09-03T23:56:39.375ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
58682024-09-03T23:56:39.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
58692024-09-03T23:56:39.377ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58702024-09-03T23:56:39.377ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
58712024-09-03T23:56:39.377ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 3d837478-6c27-4614-b539-014b54fe9c3e dns_zone_name = oxide.test found_so_far = 0 version = 2
58722024-09-03T23:56:39.377ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
58732024-09-03T23:56:39.377ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
58742024-09-03T23:56:39.379ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58752024-09-03T23:56:39.380ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
58762024-09-03T23:56:39.380ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
58772024-09-03T23:56:39.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
58782024-09-03T23:56:39.381ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
58792024-09-03T23:56:39.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
58802024-09-03T23:56:39.382ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
58812024-09-03T23:56:39.382ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
58822024-09-03T23:56:39.382ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
58832024-09-03T23:56:39.382ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
58842024-09-03T23:56:39.382ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
58852024-09-03T23:56:39.382ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 35395b13-f2fe-45cc-ba7e-90fa45dea705 dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
58862024-09-03T23:56:39.382ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
58872024-09-03T23:56:39.382ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-09-03 23:51:41.890432 UTC dns_group = internal generation = 1
58882024-09-03T23:56:39.382ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 137.844098ms iteration = 6 status = {"generation":1}
58892024-09-03T23:56:39.384ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 3d837478-6c27-4614-b539-014b54fe9c3e dns_zone_name = oxide.test found_so_far = 1 version = 2
58902024-09-03T23:56:39.384ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
58912024-09-03T23:56:39.384ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-09-03 23:51:42.685737 UTC dns_group = external generation = 2
58922024-09-03T23:56:39.384ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 139.617777ms iteration = 6 status = {"generation":2}
58932024-09-03T23:56:39.384ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58942024-09-03T23:56:39.387ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
58952024-09-03T23:56:39.387ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
58962024-09-03T23:56:39.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
58972024-09-03T23:56:39.389ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
58982024-09-03T23:56:39.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
58992024-09-03T23:56:39.391ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59002024-09-03T23:56:39.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59012024-09-03T23:56:39.391ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 140.092157ms iteration = 11 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
59022024-09-03T23:56:39.393ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59032024-09-03T23:56:39.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59042024-09-03T23:56:39.394ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-09-03T23:51:37.486746Z, time_modified: 2024-09-03T23:51:37.486746Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 8448d8a2-33e4-4746-ac02-db97b8df3ca4, db_silo: Silo { identity: SiloIdentity { id: 8448d8a2-33e4-4746-ac02-db97b8df3ca4, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-09-03T23:51:42.648012Z, time_modified: 2024-09-03T23:51:42.648012Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "294cc86510f94c68a456b8ade6786c3fe5efad002008ff9982b0149d3f4d8d7a" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 8448d8a2-33e4-4746-ac02-db97b8df3ca4, db_silo: Silo { identity: SiloIdentity { id: 8448d8a2-33e4-4746-ac02-db97b8df3ca4, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-09-03T23:51:42.648012Z, time_modified: 2024-09-03T23:51:42.648012Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "294cc86510f94c68a456b8ade6786c3fe5efad002008ff9982b0149d3f4d8d7a" }] }) }
59052024-09-03T23:56:39.394ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 149.608502ms iteration = 6 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"8448d8a2-33e4-4746-ac02-db97b8df3ca4","tls_certs":["294cc86510f94c68a456b8ade6786c3fe5efad002008ff9982b0149d3f4d8d7a"]}},"default_endpoint":{"silo_id":"8448d8a2-33e4-4746-ac02-db97b8df3ca4","tls_certs":["294cc86510f94c68a456b8ade6786c3fe5efad002008ff9982b0149d3f4d8d7a"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
59062024-09-03T23:56:39.395ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59072024-09-03T23:56:39.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59082024-09-03T23:56:39.397ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59092024-09-03T23:56:39.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59102024-09-03T23:56:39.399ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59112024-09-03T23:56:39.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59122024-09-03T23:56:39.400ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59132024-09-03T23:56:39.403ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
59142024-09-03T23:56:39.403ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59152024-09-03T23:56:39.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59162024-09-03T23:56:39.405ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59172024-09-03T23:56:39.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59182024-09-03T23:56:39.407ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59192024-09-03T23:56:39.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59202024-09-03T23:56:39.409ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59212024-09-03T23:56:39.410ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59222024-09-03T23:56:39.412ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59232024-09-03T23:56:39.412ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59242024-09-03T23:56:39.413ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59252024-09-03T23:56:39.413ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59262024-09-03T23:56:39.414ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59272024-09-03T23:56:39.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59282024-09-03T23:56:39.416ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59292024-09-03T23:56:39.417ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59302024-09-03T23:56:39.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59312024-09-03T23:56:39.418ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
59322024-09-03T23:56:39.418ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
59332024-09-03T23:56:39.418ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "83a917f8-00a1-4287-82a8-b5ef52cd3f11", "content-length": "26", "date": "Tue, 03 Sep 2024 23:56:39 GMT"} })
59342024-09-03T23:56:39.418ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
59352024-09-03T23:56:39.418ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59362024-09-03T23:56:39.419ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
59372024-09-03T23:56:39.419ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59382024-09-03T23:56:39.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59392024-09-03T23:56:39.419ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
59402024-09-03T23:56:39.420ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59412024-09-03T23:56:39.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59422024-09-03T23:56:39.421ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
59432024-09-03T23:56:39.421ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59442024-09-03T23:56:39.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59452024-09-03T23:56:39.422ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59462024-09-03T23:56:39.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59472024-09-03T23:56:39.422ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59482024-09-03T23:56:39.423ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59492024-09-03T23:56:39.424ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
59502024-09-03T23:56:39.424ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59512024-09-03T23:56:39.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59522024-09-03T23:56:39.427ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
59532024-09-03T23:56:39.427ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59542024-09-03T23:56:39.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59552024-09-03T23:56:39.431ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 184.566154ms iteration = 13 status = {"physical_disks_added":0}
59562024-09-03T23:56:39.432ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df zone_address = fd00:1122:3344:101::2
59572024-09-03T23:56:39.432ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
59582024-09-03T23:56:39.433ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "90446f45-a8df-4cd6-aa25-dd4f03c82fe7", "content-length": "26", "date": "Tue, 03 Sep 2024 23:56:39 GMT"} })
59592024-09-03T23:56:39.433ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
59602024-09-03T23:56:39.435ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df
59612024-09-03T23:56:39.437ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59622024-09-03T23:56:39.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59632024-09-03T23:56:39.439ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59642024-09-03T23:56:39.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59652024-09-03T23:56:39.441ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59662024-09-03T23:56:39.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59672024-09-03T23:56:39.443ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59682024-09-03T23:56:39.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59692024-09-03T23:56:39.635ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50060 req_id = 0742d21c-d3ce-4df0-88ae-0806eea0c8b0 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
59702024-09-03T23:56:39.635ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50060 req_id = 0742d21c-d3ce-4df0-88ae-0806eea0c8b0 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
59712024-09-03T23:56:39.649ZDEBGnexus (BackgroundTasks): client request SledAgent = b281022b-35b2-452e-ad2b-78e12f6ca16a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
59722024-09-03T23:56:39.649ZDEBGnexus (BackgroundTasks): client response SledAgent = b281022b-35b2-452e-ad2b-78e12f6ca16a background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "38f17599-2a96-47c6-af46-8a934e2bec9f", "content-length": "372", "date": "Tue, 03 Sep 2024 23:56:39 GMT"} })
59732024-09-03T23:56:39.649ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59742024-09-03T23:56:39.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59752024-09-03T23:56:39.657ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
59762024-09-03T23:56:39.658ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
59772024-09-03T23:56:39.674ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 429.571461ms iteration = 11 status = {}
59782024-09-03T23:56:39.720ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
59792024-09-03T23:56:39.720ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
59802024-09-03T23:56:39.720ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "833a733b-6bb0-4a2c-a03d-e34a845a19b3", "content-length": "26", "date": "Tue, 03 Sep 2024 23:56:39 GMT"} })
59812024-09-03T23:56:39.720ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
59822024-09-03T23:56:39.721ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
59832024-09-03T23:56:39.788ZDEBGnexus (BackgroundTasks): client request SledAgent = b281022b-35b2-452e-ad2b-78e12f6ca16a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
59842024-09-03T23:56:39.788ZDEBGnexus (BackgroundTasks): client response SledAgent = b281022b-35b2-452e-ad2b-78e12f6ca16a background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e2b3b9f5-6d74-475d-b8ba-1c1805709684", "content-length": "691", "date": "Tue, 03 Sep 2024 23:56:39 GMT"} })
59852024-09-03T23:56:39.788ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
59862024-09-03T23:56:39.788ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
59872024-09-03T23:56:39.788ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
59882024-09-03T23:56:39.790ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 542.748938ms iteration = 11 status = {}
59892024-09-03T23:56:39.790ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59902024-09-03T23:56:39.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59912024-09-03T23:56:39.791ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 156618 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50060 req_id = 0742d21c-d3ce-4df0-88ae-0806eea0c8b0 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
59922024-09-03T23:56:39.792ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59932024-09-03T23:56:39.793ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59942024-09-03T23:56:39.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59952024-09-03T23:56:39.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59962024-09-03T23:56:39.795ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59972024-09-03T23:56:39.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59982024-09-03T23:56:39.797ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59992024-09-03T23:56:39.797ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60002024-09-03T23:56:39.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60012024-09-03T23:56:39.801ZDEBGnexus (BackgroundTasks): client request SledAgent = b281022b-35b2-452e-ad2b-78e12f6ca16a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
60022024-09-03T23:56:39.802ZDEBGnexus (BackgroundTasks): client response SledAgent = b281022b-35b2-452e-ad2b-78e12f6ca16a background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "725d044b-3188-4300-ad8d-5003f85badb5", "date": "Tue, 03 Sep 2024 23:56:39 GMT"} })
60032024-09-03T23:56:39.802ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
60042024-09-03T23:56:39.802ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
60052024-09-03T23:56:39.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
60062024-09-03T23:56:39.803ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 551.856694ms iteration = 11 status = {}
60072024-09-03T23:56:39.804ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
60082024-09-03T23:56:39.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
60092024-09-03T23:56:39.805ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
60102024-09-03T23:56:39.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
60112024-09-03T23:56:39.807ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60122024-09-03T23:56:39.812ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
60132024-09-03T23:56:39.812ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
60142024-09-03T23:56:39.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
60152024-09-03T23:56:39.818ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 2976bd07-76bd-4399-870b-d0394e02e2a3, kind: Service { id: 5a19fea2-ef2a-4710-a2dc-f909b9134850 }, name: Name("nexus-5a19fea2-ef2a-4710-a2dc-f909b9134850"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 232, 221])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 4c70480a-1678-45e9-b6dd-7c33aaf09ba7, kind: Service { id: 5f5ce676-2064-4d97-b873-fbcbc29495de }, name: Name("nexus-5f5ce676-2064-4d97-b873-fbcbc29495de"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 145, 61])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: eca333f3-d503-438d-96c9-fdd58cc22e48, kind: Service { id: 6a103559-9ed4-4654-9b5e-18577b1b0579 }, name: Name("nexus-6a103559-9ed4-4654-9b5e-18577b1b0579"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 187])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: 07996add-44ce-4253-be85-4745eb2604d5, kind: Service { id: 90a0c753-ce30-4bd3-a374-17c504cb8aee }, name: Name("external-dns-90a0c753-ce30-4bd3-a374-17c504cb8aee"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 251, 48])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 716ed353-46fc-4036-8260-0f0a30a9b8c2, kind: Service { id: 1f2af9fb-1e02-483c-afd2-2b8742b46afd }, name: Name("external-dns-1f2af9fb-1e02-483c-afd2-2b8742b46afd"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 138, 121])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
60162024-09-03T23:56:39.818ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
60172024-09-03T23:56:39.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
60182024-09-03T23:56:39.820ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60192024-09-03T23:56:39.822ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
60202024-09-03T23:56:39.822ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
60212024-09-03T23:56:39.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
60222024-09-03T23:56:39.823ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
60232024-09-03T23:56:39.824ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 07996add-44ce-4253-be85-4745eb2604d5, kind: Service { id: 90a0c753-ce30-4bd3-a374-17c504cb8aee }, name: Name("external-dns-90a0c753-ce30-4bd3-a374-17c504cb8aee"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 251, 48])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 716ed353-46fc-4036-8260-0f0a30a9b8c2, kind: Service { id: 1f2af9fb-1e02-483c-afd2-2b8742b46afd }, name: Name("external-dns-1f2af9fb-1e02-483c-afd2-2b8742b46afd"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 138, 121])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 2976bd07-76bd-4399-870b-d0394e02e2a3, kind: Service { id: 5a19fea2-ef2a-4710-a2dc-f909b9134850 }, name: Name("nexus-5a19fea2-ef2a-4710-a2dc-f909b9134850"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 232, 221])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 4c70480a-1678-45e9-b6dd-7c33aaf09ba7, kind: Service { id: 5f5ce676-2064-4d97-b873-fbcbc29495de }, name: Name("nexus-5f5ce676-2064-4d97-b873-fbcbc29495de"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 145, 61])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: eca333f3-d503-438d-96c9-fdd58cc22e48, kind: Service { id: 6a103559-9ed4-4654-9b5e-18577b1b0579 }, name: Name("nexus-6a103559-9ed4-4654-9b5e-18577b1b0579"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 187])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
60242024-09-03T23:56:39.824ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
60252024-09-03T23:56:39.857ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
60262024-09-03T23:56:39.857ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e1124c49-38a9-4c4d-8e22-46786c5b9a73", "content-length": "1", "date": "Tue, 03 Sep 2024 23:56:39 GMT"} })
60272024-09-03T23:56:39.859ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
60282024-09-03T23:56:39.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
60292024-09-03T23:56:39.861ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 616.866654ms iteration = 11 status = null
60302024-09-03T23:56:39.880ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 514 local_addr = [fd00:1122:3344:101::c]:59395 method = GET remote_addr = [fd00:1122:3344:101::d]:55949 req_id = 35a7e7ee-9130-4ba1-a566-87350674a200 response_code = 200 uri = /5f5ce676-2064-4d97-b873-fbcbc29495de
60312024-09-03T23:56:39.893ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: b281022b-35b2-452e-ad2b-78e12f6ca16a, time_created: 2024-09-03T23:51:41.530889Z, time_modified: 2024-09-03T23:51:41.530889Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 1d4636f4-828e-412a-8daf-3bda355c92df, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
60322024-09-03T23:56:39.893ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
60332024-09-03T23:56:39.895ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
60342024-09-03T23:56:39.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
60352024-09-03T23:56:39.897ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
60362024-09-03T23:56:39.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
60372024-09-03T23:56:39.899ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60382024-09-03T23:56:39.901ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: b281022b-35b2-452e-ad2b-78e12f6ca16a, lookup_type: ById(b281022b-35b2-452e-ad2b-78e12f6ca16a) } result = Ok(())
60392024-09-03T23:56:39.925ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
60402024-09-03T23:56:39.927ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
60412024-09-03T23:56:39.927ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "5138e709-128e-47d8-988f-18b3fa949939", "date": "Tue, 03 Sep 2024 23:56:39 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
60422024-09-03T23:56:39.927ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
60432024-09-03T23:56:39.928ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "0975436d-050a-4556-b424-8e8d79c8559a", "date": "Tue, 03 Sep 2024 23:56:39 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
60442024-09-03T23:56:39.928ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
60452024-09-03T23:56:39.931ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
60462024-09-03T23:56:39.931ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 686.380841ms iteration = 8 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
60472024-09-03T23:56:39.961ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = a5bf671e-831f-42aa-8901-ae1d1f3bf972 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
60482024-09-03T23:56:39.962ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = a5bf671e-831f-42aa-8901-ae1d1f3bf972 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
60492024-09-03T23:56:39.963ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2068 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = a5bf671e-831f-42aa-8901-ae1d1f3bf972 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
60502024-09-03T23:56:40.001ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = b281022b-35b2-452e-ad2b-78e12f6ca16a background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
60512024-09-03T23:56:40.001ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = b281022b-35b2-452e-ad2b-78e12f6ca16a background_task = service_firewall_rule_propagation result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", query: None, fragment: None }, status: 204, headers: {"x-request-id": "196b470a-1052-4664-9c03-87d651082f73", "date": "Tue, 03 Sep 2024 23:56:39 GMT"} })
60522024-09-03T23:56:40.003ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60532024-09-03T23:56:40.003ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
60542024-09-03T23:56:40.003ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 751.870162ms
60552024-09-03T23:56:40.003ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 751.878392ms iteration = 2 status = {}
60562024-09-03T23:56:40.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60572024-09-03T23:56:40.005ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: ec64e2ff-6fd0-4ab3-a8fa-a8a710b73297, rack_id: 1d4636f4-828e-412a-8daf-3bda355c92df, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(ccbb015a-58a4-4f0f-8a1a-5716d0b9db06) } rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df switch_location = Switch0
60582024-09-03T23:56:40.005ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60592024-09-03T23:56:40.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60602024-09-03T23:56:40.008ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
60612024-09-03T23:56:40.009ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "a7dffb94-b6ef-4e2c-8cce-bdc9b805fa6d", "date": "Tue, 03 Sep 2024 23:56:40 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
60622024-09-03T23:56:40.009ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
60632024-09-03T23:56:40.010ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "3dd59581-1182-4455-9180-f543da8c6067", "date": "Tue, 03 Sep 2024 23:56:40 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
60642024-09-03T23:56:40.010ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
60652024-09-03T23:56:40.012ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "4624e51f-784c-469f-87f5-5af95a59a2b0", "date": "Tue, 03 Sep 2024 23:56:39 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
60662024-09-03T23:56:40.012ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
60672024-09-03T23:56:40.014ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
60682024-09-03T23:56:40.014ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 769.652094ms iteration = 8 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
60692024-09-03T23:56:40.116ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
60702024-09-03T23:56:40.117ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "580a84e2-67b2-4921-9432-3adb4a446696", "content-length": "121", "date": "Tue, 03 Sep 2024 23:56:39 GMT"} })
60712024-09-03T23:56:40.117ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
60722024-09-03T23:56:40.117ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = ccbb015a-58a4-4f0f-8a1a-5716d0b9db06
60732024-09-03T23:56:40.117ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
60742024-09-03T23:56:40.117ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
60752024-09-03T23:56:40.117ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df routes = {}
60762024-09-03T23:56:40.117ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df routes = {}
60772024-09-03T23:56:40.117ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df
60782024-09-03T23:56:40.117ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60792024-09-03T23:56:40.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60802024-09-03T23:56:40.119ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
60812024-09-03T23:56:40.120ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d77e9696-4957-4438-90a2-1be70b461502", "content-length": "2", "date": "Tue, 03 Sep 2024 23:56:39 GMT"} })
60822024-09-03T23:56:40.120ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
60832024-09-03T23:56:40.120ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d5729da9-0ba6-4906-9bb9-bb8d0fef433b", "content-length": "52", "date": "Tue, 03 Sep 2024 23:56:39 GMT"} })
60842024-09-03T23:56:40.120ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df switch_location = Switch0
60852024-09-03T23:56:40.120ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
60862024-09-03T23:56:40.218ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "da527890-df83-4bbd-97ef-6301592e6c65", "date": "Tue, 03 Sep 2024 23:56:39 GMT"} })
60872024-09-03T23:56:40.219ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df switch = Switch0
60882024-09-03T23:56:40.219ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
60892024-09-03T23:56:40.219ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ece5cf83-d20f-41cc-a491-ff69c798572e", "content-length": "667", "date": "Tue, 03 Sep 2024 23:56:39 GMT"} })
60902024-09-03T23:56:40.219ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60912024-09-03T23:56:40.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60922024-09-03T23:56:40.223ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60932024-09-03T23:56:40.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60942024-09-03T23:56:40.226ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60952024-09-03T23:56:40.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60962024-09-03T23:56:40.228ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60972024-09-03T23:56:40.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60982024-09-03T23:56:40.234ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 987.66724ms iteration = 11 status = {}
60992024-09-03T23:56:40.984ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 55550b25-2bc5-4eb9-9cba-7ed8954708bc roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
61002024-09-03T23:56:40.985ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 55550b25-2bc5-4eb9-9cba-7ed8954708bc resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
61012024-09-03T23:56:40.986ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2156 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 55550b25-2bc5-4eb9-9cba-7ed8954708bc response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
61022024-09-03T23:56:42.005ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 5e1f5999-5a35-4285-a42e-dd6155f91b69 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
61032024-09-03T23:56:42.005ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 5e1f5999-5a35-4285-a42e-dd6155f91b69 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
61042024-09-03T23:56:42.007ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1656 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 5e1f5999-5a35-4285-a42e-dd6155f91b69 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
61052024-09-03T23:56:43.026ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 1d8087b3-a2cd-4a2b-a8ce-437d62211a4b roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
61062024-09-03T23:56:43.027ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 1d8087b3-a2cd-4a2b-a8ce-437d62211a4b resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
61072024-09-03T23:56:43.028ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1883 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 1d8087b3-a2cd-4a2b-a8ce-437d62211a4b response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
61082024-09-03T23:56:44.048ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = a738e9e0-c663-4c6c-99a8-19dd8b46f41c roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
61092024-09-03T23:56:44.048ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = a738e9e0-c663-4c6c-99a8-19dd8b46f41c resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
61102024-09-03T23:56:44.050ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2271 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = a738e9e0-c663-4c6c-99a8-19dd8b46f41c response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
61112024-09-03T23:56:45.070ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 01fdf253-a5ae-4603-9edf-99c731a44097 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
61122024-09-03T23:56:45.070ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 01fdf253-a5ae-4603-9edf-99c731a44097 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
61132024-09-03T23:56:45.072ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2522 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 01fdf253-a5ae-4603-9edf-99c731a44097 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
61142024-09-03T23:56:46.093ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 7b4ed143-a6ad-4d5e-8aa0-209be2914a7b roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
61152024-09-03T23:56:46.093ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 7b4ed143-a6ad-4d5e-8aa0-209be2914a7b resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
61162024-09-03T23:56:46.095ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2573 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 7b4ed143-a6ad-4d5e-8aa0-209be2914a7b response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
61172024-09-03T23:56:47.117ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = ff13854c-a54e-4f1d-b6b2-049e5ae3c5ce roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
61182024-09-03T23:56:47.117ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = ff13854c-a54e-4f1d-b6b2-049e5ae3c5ce resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
61192024-09-03T23:56:47.119ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3017 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = ff13854c-a54e-4f1d-b6b2-049e5ae3c5ce response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
61202024-09-03T23:56:48.138ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = d0f65d69-0727-4274-88d0-2790a484d09d roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
61212024-09-03T23:56:48.138ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = d0f65d69-0727-4274-88d0-2790a484d09d resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
61222024-09-03T23:56:48.140ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2186 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = d0f65d69-0727-4274-88d0-2790a484d09d response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
61232024-09-03T23:56:49.160ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 41ae49b0-c70f-4ee8-91cc-617f6162108d roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
61242024-09-03T23:56:49.161ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 41ae49b0-c70f-4ee8-91cc-617f6162108d resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
61252024-09-03T23:56:49.163ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2257 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 41ae49b0-c70f-4ee8-91cc-617f6162108d response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
61262024-09-03T23:56:49.245ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 32 reason = Timeout
61272024-09-03T23:56:49.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61282024-09-03T23:56:49.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61292024-09-03T23:56:49.247ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61302024-09-03T23:56:49.250ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
61312024-09-03T23:56:49.250ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61322024-09-03T23:56:49.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61332024-09-03T23:56:49.251ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 32 reason = Timeout
61342024-09-03T23:56:49.251ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61352024-09-03T23:56:49.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61362024-09-03T23:56:49.252ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61372024-09-03T23:56:49.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61382024-09-03T23:56:49.253ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61392024-09-03T23:56:49.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61402024-09-03T23:56:49.254ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61412024-09-03T23:56:49.254ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.401253ms iteration = 32 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
61422024-09-03T23:56:49.256ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b1196b3e-aa3c-4486-a0ad-52f372819a8f, lookup_type: ById(b1196b3e-aa3c-4486-a0ad-52f372819a8f) } result = Ok(())
61432024-09-03T23:56:49.256ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61442024-09-03T23:56:49.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61452024-09-03T23:56:49.265ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b1196b3e-aa3c-4486-a0ad-52f372819a8f original_time_created = 2024-09-03 23:51:19.204380 UTC target_id = b1196b3e-aa3c-4486-a0ad-52f372819a8f time_created = 2024-09-03 23:51:19.204380 UTC
61462024-09-03T23:56:49.265ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.639894ms iteration = 32 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b1196b3e-aa3c-4486-a0ad-52f372819a8f","time_created":"2024-09-03T23:51:19.204380Z"}
61472024-09-03T23:56:49.880ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 493 local_addr = [fd00:1122:3344:101::c]:59395 method = GET remote_addr = [fd00:1122:3344:101::d]:55949 req_id = 44fe7d02-d8f5-4f5e-8e19-9f1de49a7488 response_code = 200 uri = /5f5ce676-2064-4d97-b873-fbcbc29495de
61482024-09-03T23:56:50.183ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = e3c60e63-36dd-4e25-9123-dc4daca7fb95 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
61492024-09-03T23:56:50.183ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = e3c60e63-36dd-4e25-9123-dc4daca7fb95 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
61502024-09-03T23:56:50.185ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2296 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = e3c60e63-36dd-4e25-9123-dc4daca7fb95 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
61512024-09-03T23:56:51.205ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = ded8e29f-43c6-4c0e-b6dc-2c830b51db80 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
61522024-09-03T23:56:51.205ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = ded8e29f-43c6-4c0e-b6dc-2c830b51db80 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
61532024-09-03T23:56:51.207ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1988 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = ded8e29f-43c6-4c0e-b6dc-2c830b51db80 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
61542024-09-03T23:56:52.227ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 66d64c13-5582-44c2-9fa5-32b8d8ccefef roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
61552024-09-03T23:56:52.227ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 66d64c13-5582-44c2-9fa5-32b8d8ccefef resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
61562024-09-03T23:56:52.228ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2522 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 66d64c13-5582-44c2-9fa5-32b8d8ccefef response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
61572024-09-03T23:56:53.249ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 03462c48-b592-4273-8e10-f3e86a019e04 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
61582024-09-03T23:56:53.249ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 03462c48-b592-4273-8e10-f3e86a019e04 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
61592024-09-03T23:56:53.251ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2043 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 03462c48-b592-4273-8e10-f3e86a019e04 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
61602024-09-03T23:56:54.271ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 16ed1602-39fb-4605-8bcc-5d61a6453fc5 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
61612024-09-03T23:56:54.271ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 16ed1602-39fb-4605-8bcc-5d61a6453fc5 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
61622024-09-03T23:56:54.273ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2099 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 16ed1602-39fb-4605-8bcc-5d61a6453fc5 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
61632024-09-03T23:56:55.291ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 66a98fbb-2eca-4e4d-9087-88136aa297c0 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
61642024-09-03T23:56:55.292ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 66a98fbb-2eca-4e4d-9087-88136aa297c0 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
61652024-09-03T23:56:55.294ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2890 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 66a98fbb-2eca-4e4d-9087-88136aa297c0 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
61662024-09-03T23:56:56.313ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 888a886b-c758-44e8-a46e-58166c10423f roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
61672024-09-03T23:56:56.313ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 888a886b-c758-44e8-a46e-58166c10423f resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
61682024-09-03T23:56:56.315ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2245 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 888a886b-c758-44e8-a46e-58166c10423f response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
61692024-09-03T23:56:57.336ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = c66f1955-5144-4a79-90c7-ea0b3acaf2c6 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
61702024-09-03T23:56:57.336ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = c66f1955-5144-4a79-90c7-ea0b3acaf2c6 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
61712024-09-03T23:56:57.338ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2370 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = c66f1955-5144-4a79-90c7-ea0b3acaf2c6 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
61722024-09-03T23:56:58.357ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = d8876fac-85a4-4462-8d43-7fc469316872 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
61732024-09-03T23:56:58.357ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = d8876fac-85a4-4462-8d43-7fc469316872 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
61742024-09-03T23:56:58.359ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2371 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = d8876fac-85a4-4462-8d43-7fc469316872 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
61752024-09-03T23:56:59.245ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 33 reason = Timeout
61762024-09-03T23:56:59.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61772024-09-03T23:56:59.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61782024-09-03T23:56:59.247ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61792024-09-03T23:56:59.249ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
61802024-09-03T23:56:59.249ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61812024-09-03T23:56:59.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61822024-09-03T23:56:59.251ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61832024-09-03T23:56:59.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61842024-09-03T23:56:59.251ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 33 reason = Timeout
61852024-09-03T23:56:59.251ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61862024-09-03T23:56:59.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61872024-09-03T23:56:59.253ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61882024-09-03T23:56:59.253ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61892024-09-03T23:56:59.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61902024-09-03T23:56:59.254ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.075966ms iteration = 33 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
61912024-09-03T23:56:59.255ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b1196b3e-aa3c-4486-a0ad-52f372819a8f, lookup_type: ById(b1196b3e-aa3c-4486-a0ad-52f372819a8f) } result = Ok(())
61922024-09-03T23:56:59.255ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61932024-09-03T23:56:59.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61942024-09-03T23:56:59.262ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b1196b3e-aa3c-4486-a0ad-52f372819a8f original_time_created = 2024-09-03 23:51:19.204380 UTC target_id = b1196b3e-aa3c-4486-a0ad-52f372819a8f time_created = 2024-09-03 23:51:19.204380 UTC
61952024-09-03T23:56:59.262ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.341173ms iteration = 33 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b1196b3e-aa3c-4486-a0ad-52f372819a8f","time_created":"2024-09-03T23:51:19.204380Z"}
61962024-09-03T23:56:59.381ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = e42503c0-5ce4-476c-824e-25508954b4a0 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
61972024-09-03T23:56:59.381ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = e42503c0-5ce4-476c-824e-25508954b4a0 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
61982024-09-03T23:56:59.383ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2048 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = e42503c0-5ce4-476c-824e-25508954b4a0 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
61992024-09-03T23:56:59.880ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 432 local_addr = [fd00:1122:3344:101::c]:59395 method = GET remote_addr = [fd00:1122:3344:101::d]:55949 req_id = 6108df88-4150-41c6-8c35-c7183fdd0d1d response_code = 200 uri = /5f5ce676-2064-4d97-b873-fbcbc29495de
62002024-09-03T23:57:00.402ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 18277bcd-cda1-4488-98b3-e5a7caad6178 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
62012024-09-03T23:57:00.402ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 18277bcd-cda1-4488-98b3-e5a7caad6178 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
62022024-09-03T23:57:00.404ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2533 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 18277bcd-cda1-4488-98b3-e5a7caad6178 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
62032024-09-03T23:57:01.424ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 3b8b2caf-dc20-42f3-8ddc-7342416740c7 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
62042024-09-03T23:57:01.425ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 3b8b2caf-dc20-42f3-8ddc-7342416740c7 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
62052024-09-03T23:57:01.426ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2547 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 3b8b2caf-dc20-42f3-8ddc-7342416740c7 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
62062024-09-03T23:57:02.448ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 40e32d13-3747-4be1-b489-2d762658111e roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
62072024-09-03T23:57:02.448ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 40e32d13-3747-4be1-b489-2d762658111e resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
62082024-09-03T23:57:02.450ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2338 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 40e32d13-3747-4be1-b489-2d762658111e response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
62092024-09-03T23:57:03.471ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 4dbe7042-0e15-4ce8-8513-b3bdb9bdc48b roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
62102024-09-03T23:57:03.471ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 4dbe7042-0e15-4ce8-8513-b3bdb9bdc48b resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
62112024-09-03T23:57:03.473ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2567 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 4dbe7042-0e15-4ce8-8513-b3bdb9bdc48b response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
62122024-09-03T23:57:04.492ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 739b7df3-4771-4e33-918e-85401e753be3 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
62132024-09-03T23:57:04.492ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 739b7df3-4771-4e33-918e-85401e753be3 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
62142024-09-03T23:57:04.494ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2093 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 739b7df3-4771-4e33-918e-85401e753be3 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
62152024-09-03T23:57:05.514ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = b1d152f0-b49b-4b9e-bae8-cb6c8601866e roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
62162024-09-03T23:57:05.514ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = b1d152f0-b49b-4b9e-bae8-cb6c8601866e resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
62172024-09-03T23:57:05.516ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1953 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = b1d152f0-b49b-4b9e-bae8-cb6c8601866e response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
62182024-09-03T23:57:05.818ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50060 req_id = b321b693-bc18-4141-ab8f-29ab37e0e0d1 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
62192024-09-03T23:57:05.818ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50060 req_id = b321b693-bc18-4141-ab8f-29ab37e0e0d1 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
62202024-09-03T23:57:05.821ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3030 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50060 req_id = b321b693-bc18-4141-ab8f-29ab37e0e0d1 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
62212024-09-03T23:57:05.822ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50060 req_id = 2029ca4d-5b2f-49b3-89b4-b6e181860e64 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/9?limit=100
62222024-09-03T23:57:05.822ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50060 req_id = 2029ca4d-5b2f-49b3-89b4-b6e181860e64 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/9?limit=100
62232024-09-03T23:57:05.824ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2251 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50060 req_id = 2029ca4d-5b2f-49b3-89b4-b6e181860e64 response_code = 200 uri = /nat/ipv4/changeset/9?limit=100
62242024-09-03T23:57:06.535ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 30df52d7-3903-4643-9e08-88246ea74d09 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
62252024-09-03T23:57:06.535ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 30df52d7-3903-4643-9e08-88246ea74d09 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
62262024-09-03T23:57:06.537ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2445 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 30df52d7-3903-4643-9e08-88246ea74d09 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
62272024-09-03T23:57:07.558ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 516889c4-b379-490c-816c-a1153c4ca3fe roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
62282024-09-03T23:57:07.558ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 516889c4-b379-490c-816c-a1153c4ca3fe resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
62292024-09-03T23:57:07.560ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2543 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 516889c4-b379-490c-816c-a1153c4ca3fe response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
62302024-09-03T23:57:08.580ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = b09d9cca-a3c9-424d-abb0-611a209486a2 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
62312024-09-03T23:57:08.580ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = b09d9cca-a3c9-424d-abb0-611a209486a2 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
62322024-09-03T23:57:08.582ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2173 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = b09d9cca-a3c9-424d-abb0-611a209486a2 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
62332024-09-03T23:57:09.245ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 12 reason = Timeout
62342024-09-03T23:57:09.245ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 34 reason = Timeout
62352024-09-03T23:57:09.245ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 12 reason = Timeout
62362024-09-03T23:57:09.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62372024-09-03T23:57:09.245ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
62382024-09-03T23:57:09.245ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 12 reason = Timeout
62392024-09-03T23:57:09.245ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
62402024-09-03T23:57:09.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62412024-09-03T23:57:09.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
62422024-09-03T23:57:09.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
62432024-09-03T23:57:09.247ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 12 reason = Timeout
62442024-09-03T23:57:09.247ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 12 reason = Timeout
62452024-09-03T23:57:09.247ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62462024-09-03T23:57:09.247ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
62472024-09-03T23:57:09.247ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 12 reason = Timeout
62482024-09-03T23:57:09.247ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 14 reason = Timeout
62492024-09-03T23:57:09.247ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62502024-09-03T23:57:09.247ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 12 reason = Timeout
62512024-09-03T23:57:09.247ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
62522024-09-03T23:57:09.247ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
62532024-09-03T23:57:09.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62542024-09-03T23:57:09.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
62552024-09-03T23:57:09.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
62562024-09-03T23:57:09.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62572024-09-03T23:57:09.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
62582024-09-03T23:57:09.247ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62592024-09-03T23:57:09.248ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.77224ms iteration = 12 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
62602024-09-03T23:57:09.248ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b281022b-35b2-452e-ad2b-78e12f6ca16a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b281022b-35b2-452e-ad2b-78e12f6ca16a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1407, tv_nsec: 749489496 } })
62612024-09-03T23:57:09.249ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62622024-09-03T23:57:09.249ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
62632024-09-03T23:57:09.251ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
62642024-09-03T23:57:09.251ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62652024-09-03T23:57:09.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62662024-09-03T23:57:09.251ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 12 reason = Timeout
62672024-09-03T23:57:09.251ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
62682024-09-03T23:57:09.251ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 12 reason = Timeout
62692024-09-03T23:57:09.251ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
62702024-09-03T23:57:09.251ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 12 reason = Timeout
62712024-09-03T23:57:09.251ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
62722024-09-03T23:57:09.251ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 12 reason = Timeout
62732024-09-03T23:57:09.251ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62742024-09-03T23:57:09.251ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 12 reason = Timeout
62752024-09-03T23:57:09.251ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
62762024-09-03T23:57:09.251ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
62772024-09-03T23:57:09.251ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 12 reason = Timeout
62782024-09-03T23:57:09.251ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
62792024-09-03T23:57:09.251ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 34 reason = Timeout
62802024-09-03T23:57:09.251ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
62812024-09-03T23:57:09.251ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 12 reason = Timeout
62822024-09-03T23:57:09.251ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
62832024-09-03T23:57:09.251ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b281022b-35b2-452e-ad2b-78e12f6ca16a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b281022b-35b2-452e-ad2b-78e12f6ca16a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1407, tv_nsec: 752259895 } })
62842024-09-03T23:57:09.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
62852024-09-03T23:57:09.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
62862024-09-03T23:57:09.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
62872024-09-03T23:57:09.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62882024-09-03T23:57:09.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
62892024-09-03T23:57:09.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
62902024-09-03T23:57:09.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
62912024-09-03T23:57:09.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
62922024-09-03T23:57:09.251ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
62932024-09-03T23:57:09.251ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
62942024-09-03T23:57:09.251ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62952024-09-03T23:57:09.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62962024-09-03T23:57:09.253ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62972024-09-03T23:57:09.254ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62982024-09-03T23:57:09.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62992024-09-03T23:57:09.256ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
63002024-09-03T23:57:09.256ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63012024-09-03T23:57:09.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63022024-09-03T23:57:09.256ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
63032024-09-03T23:57:09.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
63042024-09-03T23:57:09.258ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63052024-09-03T23:57:09.258ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63062024-09-03T23:57:09.260ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
63072024-09-03T23:57:09.260ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
63082024-09-03T23:57:09.260ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63092024-09-03T23:57:09.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63102024-09-03T23:57:09.260ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
63112024-09-03T23:57:09.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
63122024-09-03T23:57:09.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
63132024-09-03T23:57:09.261ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
63142024-09-03T23:57:09.261ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
63152024-09-03T23:57:09.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
63162024-09-03T23:57:09.261ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:56
63172024-09-03T23:57:09.261ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
63182024-09-03T23:57:09.261ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
63192024-09-03T23:57:09.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
63202024-09-03T23:57:09.262ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63212024-09-03T23:57:09.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63222024-09-03T23:57:09.263ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63232024-09-03T23:57:09.264ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b281022b-35b2-452e-ad2b-78e12f6ca16a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b281022b-35b2-452e-ad2b-78e12f6ca16a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1407, tv_nsec: 765172653 } })
63242024-09-03T23:57:09.264ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df
63252024-09-03T23:57:09.264ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 13.421359ms iteration = 34 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
63262024-09-03T23:57:09.265ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b1196b3e-aa3c-4486-a0ad-52f372819a8f, lookup_type: ById(b1196b3e-aa3c-4486-a0ad-52f372819a8f) } result = Ok(())
63272024-09-03T23:57:09.265ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63282024-09-03T23:57:09.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63292024-09-03T23:57:09.266ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63302024-09-03T23:57:09.268ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
63312024-09-03T23:57:09.268ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63322024-09-03T23:57:09.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63332024-09-03T23:57:09.271ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:56
63342024-09-03T23:57:09.271ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
63352024-09-03T23:57:09.271ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
63362024-09-03T23:57:09.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
63372024-09-03T23:57:09.276ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
63382024-09-03T23:57:09.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
63392024-09-03T23:57:09.276ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b1196b3e-aa3c-4486-a0ad-52f372819a8f original_time_created = 2024-09-03 23:51:19.204380 UTC target_id = b1196b3e-aa3c-4486-a0ad-52f372819a8f time_created = 2024-09-03 23:51:19.204380 UTC
63402024-09-03T23:57:09.276ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 30.957817ms iteration = 34 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b1196b3e-aa3c-4486-a0ad-52f372819a8f","time_created":"2024-09-03T23:51:19.204380Z"}
63412024-09-03T23:57:09.286ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
63422024-09-03T23:57:09.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
63432024-09-03T23:57:09.288ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63442024-09-03T23:57:09.291ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
63452024-09-03T23:57:09.291ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
63462024-09-03T23:57:09.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
63472024-09-03T23:57:09.294ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 43.029637ms iteration = 12 status = {"errors":[],"records_set_to_done":[]}
63482024-09-03T23:57:09.295ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63492024-09-03T23:57:09.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63502024-09-03T23:57:09.296ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 44.861826ms iteration = 12 status = {"errors":[],"garbage_collect_requested":[]}
63512024-09-03T23:57:09.301ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:56
63522024-09-03T23:57:09.301ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:241 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
63532024-09-03T23:57:09.301ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 50.418506ms iteration = 12 status = {"destroyed_active_vmms":0,"error":null,"failed_active_vmms":0,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
63542024-09-03T23:57:09.303ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 56.094648ms iteration = 12 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
63552024-09-03T23:57:09.306ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
63562024-09-03T23:57:09.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
63572024-09-03T23:57:09.357ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
63582024-09-03T23:57:09.357ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
63592024-09-03T23:57:09.358ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "5e901436-23c6-4a51-a9e2-6c96425e94ab", "content-length": "26", "date": "Tue, 03 Sep 2024 23:57:09 GMT"} })
63602024-09-03T23:57:09.358ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
63612024-09-03T23:57:09.359ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
63622024-09-03T23:57:09.412ZDEBGnexus (BackgroundTasks): client request SledAgent = b281022b-35b2-452e-ad2b-78e12f6ca16a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
63632024-09-03T23:57:09.412ZDEBGnexus (BackgroundTasks): client response SledAgent = b281022b-35b2-452e-ad2b-78e12f6ca16a background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6d54b168-18c9-42e8-bb64-d6671cbbc168", "content-length": "525", "date": "Tue, 03 Sep 2024 23:57:09 GMT"} })
63642024-09-03T23:57:09.412ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63652024-09-03T23:57:09.413ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63662024-09-03T23:57:09.445ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63672024-09-03T23:57:09.447ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
63682024-09-03T23:57:09.447ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
63692024-09-03T23:57:09.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
63702024-09-03T23:57:09.493ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 247.719085ms iteration = 12 status = {}
63712024-09-03T23:57:09.559ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
63722024-09-03T23:57:09.559ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
63732024-09-03T23:57:09.559ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "9db90468-8ac9-4e55-8e9b-aa907560e8eb", "content-length": "26", "date": "Tue, 03 Sep 2024 23:57:09 GMT"} })
63742024-09-03T23:57:09.559ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
63752024-09-03T23:57:09.560ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
63762024-09-03T23:57:09.561ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df zone_address = fd00:1122:3344:101::2
63772024-09-03T23:57:09.561ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
63782024-09-03T23:57:09.561ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "1947c2c7-dde5-4677-a9ce-90316fff366b", "content-length": "26", "date": "Tue, 03 Sep 2024 23:57:09 GMT"} })
63792024-09-03T23:57:09.561ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
63802024-09-03T23:57:09.563ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df
63812024-09-03T23:57:09.588ZDEBGnexus (BackgroundTasks): client request SledAgent = b281022b-35b2-452e-ad2b-78e12f6ca16a background_task = instance_watcher body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vmms/48c3ff33-2c5c-416c-b826-70461a3d6db6/state
63822024-09-03T23:57:09.591ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
63832024-09-03T23:57:09.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
63842024-09-03T23:57:09.591ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63852024-09-03T23:57:09.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63862024-09-03T23:57:09.592ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63872024-09-03T23:57:09.593ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63882024-09-03T23:57:09.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63892024-09-03T23:57:09.593ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63902024-09-03T23:57:09.593ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63912024-09-03T23:57:09.595ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
63922024-09-03T23:57:09.595ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
63932024-09-03T23:57:09.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
63942024-09-03T23:57:09.596ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63952024-09-03T23:57:09.596ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
63962024-09-03T23:57:09.596ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
63972024-09-03T23:57:09.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
63982024-09-03T23:57:09.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63992024-09-03T23:57:09.597ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: b281022b-35b2-452e-ad2b-78e12f6ca16a, lookup_type: ById(b281022b-35b2-452e-ad2b-78e12f6ca16a) } result = Ok(())
64002024-09-03T23:57:09.597ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
64012024-09-03T23:57:09.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
64022024-09-03T23:57:09.601ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 354.176237ms iteration = 12 status = 0
64032024-09-03T23:57:09.602ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64042024-09-03T23:57:09.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64052024-09-03T23:57:09.602ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 556ab5e6-485d-447f-b17b-36503c4fa6b8 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
64062024-09-03T23:57:09.603ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 556ab5e6-485d-447f-b17b-36503c4fa6b8 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
64072024-09-03T23:57:09.606ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3103 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 556ab5e6-485d-447f-b17b-36503c4fa6b8 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
64082024-09-03T23:57:09.606ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64092024-09-03T23:57:09.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64102024-09-03T23:57:09.609ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64112024-09-03T23:57:09.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64122024-09-03T23:57:09.612ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64132024-09-03T23:57:09.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64142024-09-03T23:57:09.614ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64152024-09-03T23:57:09.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64162024-09-03T23:57:09.616ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 365.391239ms iteration = 12 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
64172024-09-03T23:57:09.621ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64182024-09-03T23:57:09.621ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
64192024-09-03T23:57:09.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64202024-09-03T23:57:09.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
64212024-09-03T23:57:09.623ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64222024-09-03T23:57:09.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64232024-09-03T23:57:09.625ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64242024-09-03T23:57:09.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64252024-09-03T23:57:09.629ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64262024-09-03T23:57:09.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64272024-09-03T23:57:09.630ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64282024-09-03T23:57:09.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64292024-09-03T23:57:09.632ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
64302024-09-03T23:57:09.633ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "831c2791-728e-4ac7-b4a5-4e7f55697a1f", "content-length": "1", "date": "Tue, 03 Sep 2024 23:57:09 GMT"} })
64312024-09-03T23:57:09.634ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
64322024-09-03T23:57:09.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
64332024-09-03T23:57:09.638ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 393.193847ms iteration = 12 status = null
64342024-09-03T23:57:09.657ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 405.684707ms iteration = 12 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
64352024-09-03T23:57:09.662ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64362024-09-03T23:57:09.666ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 8448d8a2-33e4-4746-ac02-db97b8df3ca4, lookup_type: ById(8448d8a2-33e4-4746-ac02-db97b8df3ca4) }, key: d721a24b-8073-44fd-8adc-d541f64a7c20, lookup_type: ById(d721a24b-8073-44fd-8adc-d541f64a7c20) }, key: 96ef50d0-efd3-42a9-9c87-c9a113789133, lookup_type: ById(96ef50d0-efd3-42a9-9c87-c9a113789133) }, key: 22b1caf0-94c9-416d-b25f-8e2db252ef54, lookup_type: ById(22b1caf0-94c9-416d-b25f-8e2db252ef54) } result = Ok(())
64372024-09-03T23:57:09.666ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64382024-09-03T23:57:09.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64392024-09-03T23:57:09.680ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 433.065197ms iteration = 14 status = {"physical_disks_added":0}
64402024-09-03T23:57:09.721ZDEBGnexus (BackgroundTasks): client request SledAgent = b281022b-35b2-452e-ad2b-78e12f6ca16a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
64412024-09-03T23:57:09.723ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64422024-09-03T23:57:09.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64432024-09-03T23:57:09.725ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64442024-09-03T23:57:09.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64452024-09-03T23:57:09.727ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: ec64e2ff-6fd0-4ab3-a8fa-a8a710b73297, rack_id: 1d4636f4-828e-412a-8daf-3bda355c92df, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(ccbb015a-58a4-4f0f-8a1a-5716d0b9db06) } rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df switch_location = Switch0
64462024-09-03T23:57:09.727ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64472024-09-03T23:57:09.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64482024-09-03T23:57:09.736ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
64492024-09-03T23:57:09.736ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "4de7ff29-917d-4ac4-b44d-3f4cf3bbd42b", "content-length": "121", "date": "Tue, 03 Sep 2024 23:57:09 GMT"} })
64502024-09-03T23:57:09.736ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
64512024-09-03T23:57:09.736ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = ccbb015a-58a4-4f0f-8a1a-5716d0b9db06
64522024-09-03T23:57:09.737ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
64532024-09-03T23:57:09.737ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
64542024-09-03T23:57:09.737ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df routes = {}
64552024-09-03T23:57:09.737ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df routes = {}
64562024-09-03T23:57:09.737ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df
64572024-09-03T23:57:09.737ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64582024-09-03T23:57:09.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64592024-09-03T23:57:09.738ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
64602024-09-03T23:57:09.738ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "0c0cd664-2891-48ff-8ca4-d2731e57e8bb", "content-length": "2", "date": "Tue, 03 Sep 2024 23:57:09 GMT"} })
64612024-09-03T23:57:09.738ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
64622024-09-03T23:57:09.738ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "830b2314-6447-444e-9944-598dbb502380", "content-length": "52", "date": "Tue, 03 Sep 2024 23:57:09 GMT"} })
64632024-09-03T23:57:09.738ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df switch_location = Switch0
64642024-09-03T23:57:09.738ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
64652024-09-03T23:57:09.764ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64662024-09-03T23:57:09.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64672024-09-03T23:57:09.765ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64682024-09-03T23:57:09.769ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 8448d8a2-33e4-4746-ac02-db97b8df3ca4, lookup_type: ById(8448d8a2-33e4-4746-ac02-db97b8df3ca4) }, key: d721a24b-8073-44fd-8adc-d541f64a7c20, lookup_type: ById(d721a24b-8073-44fd-8adc-d541f64a7c20) }, key: 96ef50d0-efd3-42a9-9c87-c9a113789133, lookup_type: ById(96ef50d0-efd3-42a9-9c87-c9a113789133) }, key: 22b1caf0-94c9-416d-b25f-8e2db252ef54, lookup_type: ById(22b1caf0-94c9-416d-b25f-8e2db252ef54) } result = Ok(())
64692024-09-03T23:57:09.769ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64702024-09-03T23:57:09.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64712024-09-03T23:57:09.772ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64722024-09-03T23:57:09.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64732024-09-03T23:57:09.775ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64742024-09-03T23:57:09.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64752024-09-03T23:57:09.777ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64762024-09-03T23:57:09.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64772024-09-03T23:57:09.780ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64782024-09-03T23:57:09.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64792024-09-03T23:57:09.782ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64802024-09-03T23:57:09.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64812024-09-03T23:57:09.784ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64822024-09-03T23:57:09.784ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64832024-09-03T23:57:09.786ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64842024-09-03T23:57:09.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64852024-09-03T23:57:09.787ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64862024-09-03T23:57:09.791ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 8448d8a2-33e4-4746-ac02-db97b8df3ca4, lookup_type: ById(8448d8a2-33e4-4746-ac02-db97b8df3ca4) }, key: d721a24b-8073-44fd-8adc-d541f64a7c20, lookup_type: ById(d721a24b-8073-44fd-8adc-d541f64a7c20) }, key: 96ef50d0-efd3-42a9-9c87-c9a113789133, lookup_type: ById(96ef50d0-efd3-42a9-9c87-c9a113789133) }, key: 7a68a0b7-6082-4e8a-8d25-cbbad3180eca, lookup_type: ByName("default") } result = Ok(())
64872024-09-03T23:57:09.796ZDEBGnexus (BackgroundTasks): client request SledAgent = b281022b-35b2-452e-ad2b-78e12f6ca16a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
64882024-09-03T23:57:09.820ZDEBGnexus (BackgroundTasks): client response SledAgent = b281022b-35b2-452e-ad2b-78e12f6ca16a background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "62e27b7f-0e1e-4822-9173-ce254a0e0d16", "date": "Tue, 03 Sep 2024 23:57:09 GMT"} })
64892024-09-03T23:57:09.822ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 570.979097ms iteration = 12 status = {}
64902024-09-03T23:57:09.822ZDEBGnexus (BackgroundTasks): client response SledAgent = b281022b-35b2-452e-ad2b-78e12f6ca16a background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6089a8f1-1127-4c42-bfbc-b2d495050fa1", "content-length": "811", "date": "Tue, 03 Sep 2024 23:57:09 GMT"} })
64912024-09-03T23:57:09.822ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {VirtualNetworkInterfaceHost { physical_host_ip: fd00:1122:3344:101::1, virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 254, 33, 139])), vni: Vni(14558931) }} sled = buskin
64922024-09-03T23:57:09.822ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
64932024-09-03T23:57:09.822ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
64942024-09-03T23:57:09.824ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 577.514577ms iteration = 12 status = {}
64952024-09-03T23:57:09.880ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 435 local_addr = [fd00:1122:3344:101::c]:59395 method = GET remote_addr = [fd00:1122:3344:101::d]:55949 req_id = 4c487785-33f2-4bcd-b645-aecd79fdc44f response_code = 200 uri = /5f5ce676-2064-4d97-b873-fbcbc29495de
64962024-09-03T23:57:09.928ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "1021edba-ede9-40c8-815c-3aec61e11312", "date": "Tue, 03 Sep 2024 23:57:09 GMT"} })
64972024-09-03T23:57:09.928ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df switch = Switch0
64982024-09-03T23:57:09.928ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
64992024-09-03T23:57:09.929ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f1499fd8-5fdc-49c6-9521-66fb6e74351f", "content-length": "667", "date": "Tue, 03 Sep 2024 23:57:09 GMT"} })
65002024-09-03T23:57:09.929ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65012024-09-03T23:57:09.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65022024-09-03T23:57:09.933ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65032024-09-03T23:57:09.934ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65042024-09-03T23:57:09.937ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65052024-09-03T23:57:09.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65062024-09-03T23:57:09.939ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65072024-09-03T23:57:09.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65082024-09-03T23:57:09.947ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 700.604467ms iteration = 12 status = {}
65092024-09-03T23:57:10.628ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = feb44771-bfb9-4b4e-96a4-44053eca8f41 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
65102024-09-03T23:57:10.629ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = feb44771-bfb9-4b4e-96a4-44053eca8f41 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
65112024-09-03T23:57:10.631ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2677 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = feb44771-bfb9-4b4e-96a4-44053eca8f41 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
65122024-09-03T23:57:11.652ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = b4b3083b-821b-4d2e-86ac-a6081765e87d roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
65132024-09-03T23:57:11.652ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = b4b3083b-821b-4d2e-86ac-a6081765e87d resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
65142024-09-03T23:57:11.654ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2928 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = b4b3083b-821b-4d2e-86ac-a6081765e87d response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
65152024-09-03T23:57:12.675ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 0651a3ff-f534-457a-aaa8-b96febcdb766 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
65162024-09-03T23:57:12.676ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 0651a3ff-f534-457a-aaa8-b96febcdb766 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
65172024-09-03T23:57:12.678ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3133 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 0651a3ff-f534-457a-aaa8-b96febcdb766 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
65182024-09-03T23:57:13.379ZDEBGnexus (BackgroundTasks): client response SledAgent = b281022b-35b2-452e-ad2b-78e12f6ca16a background_task = instance_watcher result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vmms/48c3ff33-2c5c-416c-b826-70461a3d6db6/state", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "11a35b2d-34a7-4305-a488-2dd419237599", "content-length": "131", "date": "Tue, 03 Sep 2024 23:57:13 GMT"} })
65192024-09-03T23:57:13.386ZDEBGnexus (BackgroundTasks): updating instance state background_task = instance_watcher instance_id = 57689d15-57f5-498e-ba97-26ce1fb9565d state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-09-03T23:57:05.882581376Z }, migration_in: None, migration_out: None } vmm_id = 48c3ff33-2c5c-416c-b826-70461a3d6db6
65202024-09-03T23:57:13.390ZINFOnexus (BackgroundTasks): received new VMM runtime state from sled agent background_task = instance_watcher file = nexus/src/app/instance.rs:1984 instance_id = 57689d15-57f5-498e-ba97-26ce1fb9565d migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 48c3ff33-2c5c-416c-b826-70461a3d6db6 vmm_id = 48c3ff33-2c5c-416c-b826-70461a3d6db6 vmm_state = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-09-03T23:57:05.882581376Z }
65212024-09-03T23:57:13.390ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher instance_id = 57689d15-57f5-498e-ba97-26ce1fb9565d roles = RoleSet { roles: {} } vmm_id = 48c3ff33-2c5c-416c-b826-70461a3d6db6
65222024-09-03T23:57:13.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher instance_id = 57689d15-57f5-498e-ba97-26ce1fb9565d resource = Database result = Ok(()) vmm_id = 48c3ff33-2c5c-416c-b826-70461a3d6db6
65232024-09-03T23:57:13.395ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1984 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 48c3ff33-2c5c-416c-b826-70461a3d6db6 remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 997800e5-1a26-4dd9-a58d-079bfeb40739 uri = /vmms/48c3ff33-2c5c-416c-b826-70461a3d6db6 vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-09-03T23:57:13.379717907Z }
65242024-09-03T23:57:13.395ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 997800e5-1a26-4dd9-a58d-079bfeb40739 roles = RoleSet { roles: {} } uri = /vmms/48c3ff33-2c5c-416c-b826-70461a3d6db6
65252024-09-03T23:57:13.395ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 997800e5-1a26-4dd9-a58d-079bfeb40739 resource = Database result = Ok(()) uri = /vmms/48c3ff33-2c5c-416c-b826-70461a3d6db6
65262024-09-03T23:57:13.413ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 33978 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 997800e5-1a26-4dd9-a58d-079bfeb40739 response_code = 204 uri = /vmms/48c3ff33-2c5c-416c-b826-70461a3d6db6
65272024-09-03T23:57:13.425ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1984 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 48c3ff33-2c5c-416c-b826-70461a3d6db6 remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 7b3f783f-1fb6-40d1-8892-e26fd7d81d22 uri = /vmms/48c3ff33-2c5c-416c-b826-70461a3d6db6 vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-09-03T23:57:13.425587584Z }
65282024-09-03T23:57:13.425ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 7b3f783f-1fb6-40d1-8892-e26fd7d81d22 roles = RoleSet { roles: {} } uri = /vmms/48c3ff33-2c5c-416c-b826-70461a3d6db6
65292024-09-03T23:57:13.426ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 7b3f783f-1fb6-40d1-8892-e26fd7d81d22 resource = Database result = Ok(()) uri = /vmms/48c3ff33-2c5c-416c-b826-70461a3d6db6
65302024-09-03T23:57:13.436ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:480 pruned_instances = 0 total_completed = 1 total_failed = 0 total_incomplete = 0 total_instances = 1 update_sagas_queued = 0
65312024-09-03T23:57:13.436ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 4.18528622s iteration = 12 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{"starting":1},"pruned_instances":0,"total_instances":1,"update_sagas_queued":0}
65322024-09-03T23:57:13.464ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 38981 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 7b3f783f-1fb6-40d1-8892-e26fd7d81d22 response_code = 204 uri = /vmms/48c3ff33-2c5c-416c-b826-70461a3d6db6
65332024-09-03T23:57:13.698ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = faa79229-4699-41f4-ade9-ced93313ac2d roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
65342024-09-03T23:57:13.698ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = faa79229-4699-41f4-ade9-ced93313ac2d resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
65352024-09-03T23:57:13.700ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2261 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = faa79229-4699-41f4-ade9-ced93313ac2d response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
65362024-09-03T23:57:14.720ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 4fd6a007-d05d-43c6-be0b-f94ac7b40819 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
65372024-09-03T23:57:14.720ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 4fd6a007-d05d-43c6-be0b-f94ac7b40819 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
65382024-09-03T23:57:14.722ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1996 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 4fd6a007-d05d-43c6-be0b-f94ac7b40819 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
65392024-09-03T23:57:15.742ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = d64a755b-9bf3-47ad-8d59-0fa5ba5141b6 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
65402024-09-03T23:57:15.742ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = d64a755b-9bf3-47ad-8d59-0fa5ba5141b6 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
65412024-09-03T23:57:15.744ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2495 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = d64a755b-9bf3-47ad-8d59-0fa5ba5141b6 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
65422024-09-03T23:57:16.764ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 93d5e9b2-b5f0-471a-bf06-b58c9e94abb3 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
65432024-09-03T23:57:16.764ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 93d5e9b2-b5f0-471a-bf06-b58c9e94abb3 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
65442024-09-03T23:57:16.767ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2884 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 93d5e9b2-b5f0-471a-bf06-b58c9e94abb3 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
65452024-09-03T23:57:17.790ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = def1568d-e85d-4094-9f37-3d5306c716fc roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
65462024-09-03T23:57:17.790ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = def1568d-e85d-4094-9f37-3d5306c716fc resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
65472024-09-03T23:57:17.792ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2351 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = def1568d-e85d-4094-9f37-3d5306c716fc response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
65482024-09-03T23:57:18.814ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = b7485953-9f69-4c7d-a5d1-357be8579e3d roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
65492024-09-03T23:57:18.814ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = b7485953-9f69-4c7d-a5d1-357be8579e3d resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
65502024-09-03T23:57:18.817ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2740 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = b7485953-9f69-4c7d-a5d1-357be8579e3d response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
65512024-09-03T23:57:19.245ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 35 reason = Timeout
65522024-09-03T23:57:19.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65532024-09-03T23:57:19.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65542024-09-03T23:57:19.246ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65552024-09-03T23:57:19.249ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
65562024-09-03T23:57:19.249ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65572024-09-03T23:57:19.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65582024-09-03T23:57:19.251ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 35 reason = Timeout
65592024-09-03T23:57:19.251ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65602024-09-03T23:57:19.251ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65612024-09-03T23:57:19.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65622024-09-03T23:57:19.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65632024-09-03T23:57:19.253ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65642024-09-03T23:57:19.253ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65652024-09-03T23:57:19.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65662024-09-03T23:57:19.256ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.598559ms iteration = 35 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
65672024-09-03T23:57:19.256ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b1196b3e-aa3c-4486-a0ad-52f372819a8f, lookup_type: ById(b1196b3e-aa3c-4486-a0ad-52f372819a8f) } result = Ok(())
65682024-09-03T23:57:19.256ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65692024-09-03T23:57:19.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65702024-09-03T23:57:19.263ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b1196b3e-aa3c-4486-a0ad-52f372819a8f original_time_created = 2024-09-03 23:51:19.204380 UTC target_id = b1196b3e-aa3c-4486-a0ad-52f372819a8f time_created = 2024-09-03 23:51:19.204380 UTC
65712024-09-03T23:57:19.263ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.447497ms iteration = 35 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b1196b3e-aa3c-4486-a0ad-52f372819a8f","time_created":"2024-09-03T23:51:19.204380Z"}
65722024-09-03T23:57:19.835ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 79a37387-466d-4eed-be31-83f47a94c32c roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
65732024-09-03T23:57:19.836ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 79a37387-466d-4eed-be31-83f47a94c32c resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
65742024-09-03T23:57:19.838ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2475 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 79a37387-466d-4eed-be31-83f47a94c32c response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
65752024-09-03T23:57:19.880ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 762 local_addr = [fd00:1122:3344:101::c]:59395 method = GET remote_addr = [fd00:1122:3344:101::d]:55949 req_id = 0e85f067-2b4a-4ea6-b5fe-4398702c886e response_code = 200 uri = /5f5ce676-2064-4d97-b873-fbcbc29495de
65762024-09-03T23:57:20.857ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = b57d3d3c-222c-4e04-8f35-c77369e25c43 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
65772024-09-03T23:57:20.857ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = b57d3d3c-222c-4e04-8f35-c77369e25c43 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
65782024-09-03T23:57:20.859ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2366 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = b57d3d3c-222c-4e04-8f35-c77369e25c43 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
65792024-09-03T23:57:21.877ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 1c16c9d8-fc66-4ac5-8efc-b24ab080c4fd roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
65802024-09-03T23:57:21.878ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 1c16c9d8-fc66-4ac5-8efc-b24ab080c4fd resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
65812024-09-03T23:57:21.880ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2180 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 1c16c9d8-fc66-4ac5-8efc-b24ab080c4fd response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
65822024-09-03T23:57:22.899ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 3695fb97-e4db-45b2-91df-e34a83a90657 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
65832024-09-03T23:57:22.899ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 3695fb97-e4db-45b2-91df-e34a83a90657 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
65842024-09-03T23:57:22.901ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1689 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 3695fb97-e4db-45b2-91df-e34a83a90657 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
65852024-09-03T23:57:23.559ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1984 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 48c3ff33-2c5c-416c-b826-70461a3d6db6 remote_addr = [fd00:1122:3344:101::1]:49121 req_id = b2337094-3420-4127-9b40-18f9ff64f378 uri = /vmms/48c3ff33-2c5c-416c-b826-70461a3d6db6 vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-09-03T23:57:23.559576758Z }
65862024-09-03T23:57:23.559ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49121 req_id = b2337094-3420-4127-9b40-18f9ff64f378 roles = RoleSet { roles: {} } uri = /vmms/48c3ff33-2c5c-416c-b826-70461a3d6db6
65872024-09-03T23:57:23.560ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49121 req_id = b2337094-3420-4127-9b40-18f9ff64f378 resource = Database result = Ok(()) uri = /vmms/48c3ff33-2c5c-416c-b826-70461a3d6db6
65882024-09-03T23:57:23.578ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 18580 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49121 req_id = b2337094-3420-4127-9b40-18f9ff64f378 response_code = 204 uri = /vmms/48c3ff33-2c5c-416c-b826-70461a3d6db6
65892024-09-03T23:57:23.842ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50060 req_id = 86d5ce13-dbc2-420a-832c-aa425ae097d4 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/9?limit=100
65902024-09-03T23:57:23.843ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50060 req_id = 86d5ce13-dbc2-420a-832c-aa425ae097d4 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/9?limit=100
65912024-09-03T23:57:23.846ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3526 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50060 req_id = 86d5ce13-dbc2-420a-832c-aa425ae097d4 response_code = 200 uri = /nat/ipv4/changeset/9?limit=100
65922024-09-03T23:57:23.847ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50060 req_id = d155468a-81ac-467a-92f5-b8a110844567 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/11?limit=100
65932024-09-03T23:57:23.847ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50060 req_id = d155468a-81ac-467a-92f5-b8a110844567 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/11?limit=100
65942024-09-03T23:57:23.850ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2672 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50060 req_id = d155468a-81ac-467a-92f5-b8a110844567 response_code = 200 uri = /nat/ipv4/changeset/11?limit=100
65952024-09-03T23:57:23.922ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 9ec0e863-218d-4579-9932-3cfdf739335d roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
65962024-09-03T23:57:23.922ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 9ec0e863-218d-4579-9932-3cfdf739335d resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
65972024-09-03T23:57:23.924ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1986 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 9ec0e863-218d-4579-9932-3cfdf739335d response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
65982024-09-03T23:57:24.943ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = a190bf9c-4291-4bdc-81b7-ff199b87f7f4 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
65992024-09-03T23:57:24.943ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = a190bf9c-4291-4bdc-81b7-ff199b87f7f4 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
66002024-09-03T23:57:24.945ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2159 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = a190bf9c-4291-4bdc-81b7-ff199b87f7f4 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
66012024-09-03T23:57:25.852ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50060 req_id = bd6241d7-d314-4c88-95fd-260de9fe41d9 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/11?limit=100
66022024-09-03T23:57:25.853ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50060 req_id = bd6241d7-d314-4c88-95fd-260de9fe41d9 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/11?limit=100
66032024-09-03T23:57:25.856ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3495 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50060 req_id = bd6241d7-d314-4c88-95fd-260de9fe41d9 response_code = 200 uri = /nat/ipv4/changeset/11?limit=100
66042024-09-03T23:57:25.965ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 00f3eba4-e1c1-4c20-a98c-367c087673ef roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
66052024-09-03T23:57:25.965ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 00f3eba4-e1c1-4c20-a98c-367c087673ef resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
66062024-09-03T23:57:25.967ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2023 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 00f3eba4-e1c1-4c20-a98c-367c087673ef response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
66072024-09-03T23:57:25.978ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1984 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 48c3ff33-2c5c-416c-b826-70461a3d6db6 remote_addr = [fd00:1122:3344:101::1]:49121 req_id = a328d80b-dcdf-47e5-a11d-b24e409d5bda uri = /vmms/48c3ff33-2c5c-416c-b826-70461a3d6db6 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-09-03T23:57:25.978338776Z }
66082024-09-03T23:57:25.978ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49121 req_id = a328d80b-dcdf-47e5-a11d-b24e409d5bda roles = RoleSet { roles: {} } uri = /vmms/48c3ff33-2c5c-416c-b826-70461a3d6db6
66092024-09-03T23:57:25.978ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49121 req_id = a328d80b-dcdf-47e5-a11d-b24e409d5bda resource = Database result = Ok(()) uri = /vmms/48c3ff33-2c5c-416c-b826-70461a3d6db6
66102024-09-03T23:57:25.992ZDEBGnexus (dropshot_internal): new VMM runtime state from sled agent requires an instance-update saga actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_in_needs_update = false migration_out_needs_update = false propolis_id = 48c3ff33-2c5c-416c-b826-70461a3d6db6 remote_addr = [fd00:1122:3344:101::1]:49121 req_id = a328d80b-dcdf-47e5-a11d-b24e409d5bda uri = /vmms/48c3ff33-2c5c-416c-b826-70461a3d6db6 vmm_needs_update = true
66112024-09-03T23:57:25.992ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49121 req_id = a328d80b-dcdf-47e5-a11d-b24e409d5bda roles = RoleSet { roles: {} } uri = /vmms/48c3ff33-2c5c-416c-b826-70461a3d6db6
66122024-09-03T23:57:25.992ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49121 req_id = a328d80b-dcdf-47e5-a11d-b24e409d5bda resource = Database result = Ok(()) uri = /vmms/48c3ff33-2c5c-416c-b826-70461a3d6db6
66132024-09-03T23:57:25.996ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49121 req_id = a328d80b-dcdf-47e5-a11d-b24e409d5bda roles = RoleSet { roles: {} } uri = /vmms/48c3ff33-2c5c-416c-b826-70461a3d6db6
66142024-09-03T23:57:25.997ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49121 req_id = a328d80b-dcdf-47e5-a11d-b24e409d5bda resource = Database result = Ok(()) uri = /vmms/48c3ff33-2c5c-416c-b826-70461a3d6db6
66152024-09-03T23:57:25.998ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49121 req_id = a328d80b-dcdf-47e5-a11d-b24e409d5bda roles = RoleSet { roles: {} } uri = /vmms/48c3ff33-2c5c-416c-b826-70461a3d6db6
66162024-09-03T23:57:25.999ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49121 req_id = a328d80b-dcdf-47e5-a11d-b24e409d5bda resource = Database result = Ok(()) uri = /vmms/48c3ff33-2c5c-416c-b826-70461a3d6db6
66172024-09-03T23:57:26.001ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49121 req_id = a328d80b-dcdf-47e5-a11d-b24e409d5bda roles = RoleSet { roles: {} } uri = /vmms/48c3ff33-2c5c-416c-b826-70461a3d6db6
66182024-09-03T23:57:26.001ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49121 req_id = a328d80b-dcdf-47e5-a11d-b24e409d5bda resource = Database result = Ok(()) uri = /vmms/48c3ff33-2c5c-416c-b826-70461a3d6db6
66192024-09-03T23:57:26.002ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49121 req_id = a328d80b-dcdf-47e5-a11d-b24e409d5bda roles = RoleSet { roles: {} } uri = /vmms/48c3ff33-2c5c-416c-b826-70461a3d6db6
66202024-09-03T23:57:26.003ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49121 req_id = a328d80b-dcdf-47e5-a11d-b24e409d5bda resource = Database result = Ok(()) uri = /vmms/48c3ff33-2c5c-416c-b826-70461a3d6db6
66212024-09-03T23:57:26.004ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49121 req_id = a328d80b-dcdf-47e5-a11d-b24e409d5bda roles = RoleSet { roles: {} } uri = /vmms/48c3ff33-2c5c-416c-b826-70461a3d6db6
66222024-09-03T23:57:26.004ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49121 req_id = a328d80b-dcdf-47e5-a11d-b24e409d5bda resource = Database result = Ok(()) uri = /vmms/48c3ff33-2c5c-416c-b826-70461a3d6db6
66232024-09-03T23:57:26.006ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49121 req_id = a328d80b-dcdf-47e5-a11d-b24e409d5bda roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /vmms/48c3ff33-2c5c-416c-b826-70461a3d6db6
66242024-09-03T23:57:26.008ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49121 req_id = a328d80b-dcdf-47e5-a11d-b24e409d5bda resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 8448d8a2-33e4-4746-ac02-db97b8df3ca4, lookup_type: ById(8448d8a2-33e4-4746-ac02-db97b8df3ca4) }, key: d721a24b-8073-44fd-8adc-d541f64a7c20, lookup_type: ById(d721a24b-8073-44fd-8adc-d541f64a7c20) }, key: 57689d15-57f5-498e-ba97-26ce1fb9565d, lookup_type: ById(57689d15-57f5-498e-ba97-26ce1fb9565d) } result = Ok(()) uri = /vmms/48c3ff33-2c5c-416c-b826-70461a3d6db6
66252024-09-03T23:57:26.016ZINFOnexus (dropshot_internal): starting update saga for 57689d15-57f5-498e-ba97-26ce1fb9565d actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1459 instance_id = 57689d15-57f5-498e-ba97-26ce1fb9565d local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } remote_addr = [fd00:1122:3344:101::1]:49121 req_id = a328d80b-dcdf-47e5-a11d-b24e409d5bda uri = /vmms/48c3ff33-2c5c-416c-b826-70461a3d6db6 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-09-03T23:57:25.978338776Z }
66262024-09-03T23:57:26.016ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 38217 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49121 req_id = a328d80b-dcdf-47e5-a11d-b24e409d5bda response_code = 204 uri = /vmms/48c3ff33-2c5c-416c-b826-70461a3d6db6
66272024-09-03T23:57:26.016ZDEBGnexus (dropshot_internal): preparing instance-update saga for 57689d15-57f5-498e-ba97-26ce1fb9565d... actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 57689d15-57f5-498e-ba97-26ce1fb9565d local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49121 req_id = a328d80b-dcdf-47e5-a11d-b24e409d5bda uri = /vmms/48c3ff33-2c5c-416c-b826-70461a3d6db6
66282024-09-03T23:57:26.017ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1984 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 48c3ff33-2c5c-416c-b826-70461a3d6db6 remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 1aec8298-8b9d-40ab-8423-c58c0d093d50 uri = /vmms/48c3ff33-2c5c-416c-b826-70461a3d6db6 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-09-03T23:57:25.978338776Z }
66292024-09-03T23:57:26.017ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 1aec8298-8b9d-40ab-8423-c58c0d093d50 roles = RoleSet { roles: {} } uri = /vmms/48c3ff33-2c5c-416c-b826-70461a3d6db6
66302024-09-03T23:57:26.017ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 1aec8298-8b9d-40ab-8423-c58c0d093d50 resource = Database result = Ok(()) uri = /vmms/48c3ff33-2c5c-416c-b826-70461a3d6db6
66312024-09-03T23:57:26.020ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:212 saga_id = 3a2cc205-8e46-4a62-9681-f6159ba06aaf saga_name = start-instance-update
66322024-09-03T23:57:26.023ZINFOnexus (SEC): saga create dag = {"end_node":4,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,0,null],[2,4,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"start_instance_update.lock_instance","label":"LockInstance","name":"updater_lock"}},{"Action":{"action_name":"start_instance_update.fetch_state_and_start_real_saga","label":"FetchStateAndStartRealSaga","name":"state"}},{"Start":{"params":{"authz_instance":{"key":"57689d15-57f5-498e-ba97-26ce1fb9565d","lookup_type":{"ById":"57689d15-57f5-498e-ba97-26ce1fb9565d"},"parent":{"key":"d721a24b-8073-44fd-8adc-d541f64a7c20","lookup_type":{"ById":"d721a24b-8073-44fd-8adc-d541f64a7c20"},"parent":{"key":"8448d8a2-33e4-4746-ac02-db97b8df3ca4","lookup_type":{"ById":"8448d8a2-33e4-4746-ac02-db97b8df3ca4"},"parent":null}}},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}}}}},"End"]},"saga_name":"start-instance-update","start_node":3} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 3a2cc205-8e46-4a62-9681-f6159ba06aaf saga_name = start-instance-update sec_id = 5f5ce676-2064-4d97-b873-fbcbc29495de
66332024-09-03T23:57:26.023ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 3a2cc205-8e46-4a62-9681-f6159ba06aaf saga_name = start-instance-update
66342024-09-03T23:57:26.052ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:310 saga_id = 3a2cc205-8e46-4a62-9681-f6159ba06aaf saga_name = start-instance-update
66352024-09-03T23:57:26.052ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 3a2cc205-8e46-4a62-9681-f6159ba06aaf saga_name = start-instance-update sec_id = 5f5ce676-2064-4d97-b873-fbcbc29495de
66362024-09-03T23:57:26.054ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 37565 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 1aec8298-8b9d-40ab-8423-c58c0d093d50 response_code = 204 uri = /vmms/48c3ff33-2c5c-416c-b826-70461a3d6db6
66372024-09-03T23:57:26.054ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 5f5ce676-2064-4d97-b873-fbcbc29495de
66382024-09-03T23:57:26.054ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 3a2cc205-8e46-4a62-9681-f6159ba06aaf
66392024-09-03T23:57:26.061ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 5f5ce676-2064-4d97-b873-fbcbc29495de
66402024-09-03T23:57:26.061ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 3a2cc205-8e46-4a62-9681-f6159ba06aaf
66412024-09-03T23:57:26.066ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 5f5ce676-2064-4d97-b873-fbcbc29495de
66422024-09-03T23:57:26.066ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 3a2cc205-8e46-4a62-9681-f6159ba06aaf
66432024-09-03T23:57:26.073ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 5f5ce676-2064-4d97-b873-fbcbc29495de
66442024-09-03T23:57:26.073ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("773273c5-1f6c-46b5-89e1-fbe98cd536a6")) node_id = 0 saga_id = 3a2cc205-8e46-4a62-9681-f6159ba06aaf
66452024-09-03T23:57:26.078ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 5f5ce676-2064-4d97-b873-fbcbc29495de
66462024-09-03T23:57:26.078ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 3a2cc205-8e46-4a62-9681-f6159ba06aaf
66472024-09-03T23:57:26.098ZINFOnexus (SagaExecutor): instance update: attempting to lock instance file = nexus/src/app/sagas/instance_update/start.rs:93 instance_id = 57689d15-57f5-498e-ba97-26ce1fb9565d saga_id = 3a2cc205-8e46-4a62-9681-f6159ba06aaf saga_name = start-instance-update
66482024-09-03T23:57:26.102ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 3a2cc205-8e46-4a62-9681-f6159ba06aaf saga_name = start-instance-update saga_node = LockInstance
66492024-09-03T23:57:26.103ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 3a2cc205-8e46-4a62-9681-f6159ba06aaf saga_name = start-instance-update saga_node = LockInstance
66502024-09-03T23:57:26.105ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 3a2cc205-8e46-4a62-9681-f6159ba06aaf saga_name = start-instance-update saga_node = LockInstance
66512024-09-03T23:57:26.105ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 3a2cc205-8e46-4a62-9681-f6159ba06aaf saga_name = start-instance-update saga_node = LockInstance
66522024-09-03T23:57:26.107ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 3a2cc205-8e46-4a62-9681-f6159ba06aaf saga_name = start-instance-update saga_node = LockInstance
66532024-09-03T23:57:26.107ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 3a2cc205-8e46-4a62-9681-f6159ba06aaf saga_name = start-instance-update saga_node = LockInstance
66542024-09-03T23:57:26.111ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 3a2cc205-8e46-4a62-9681-f6159ba06aaf saga_name = start-instance-update saga_node = LockInstance
66552024-09-03T23:57:26.111ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 3a2cc205-8e46-4a62-9681-f6159ba06aaf saga_name = start-instance-update saga_node = LockInstance
66562024-09-03T23:57:26.112ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 3a2cc205-8e46-4a62-9681-f6159ba06aaf saga_name = start-instance-update saga_node = LockInstance
66572024-09-03T23:57:26.113ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 3a2cc205-8e46-4a62-9681-f6159ba06aaf saga_name = start-instance-update saga_node = LockInstance
66582024-09-03T23:57:26.113ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 3a2cc205-8e46-4a62-9681-f6159ba06aaf saga_name = start-instance-update saga_node = LockInstance
66592024-09-03T23:57:26.114ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 3a2cc205-8e46-4a62-9681-f6159ba06aaf saga_name = start-instance-update saga_node = LockInstance
66602024-09-03T23:57:26.115ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 3a2cc205-8e46-4a62-9681-f6159ba06aaf saga_name = start-instance-update saga_node = LockInstance
66612024-09-03T23:57:26.123ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 8448d8a2-33e4-4746-ac02-db97b8df3ca4, lookup_type: ById(8448d8a2-33e4-4746-ac02-db97b8df3ca4) }, key: d721a24b-8073-44fd-8adc-d541f64a7c20, lookup_type: ById(d721a24b-8073-44fd-8adc-d541f64a7c20) }, key: 57689d15-57f5-498e-ba97-26ce1fb9565d, lookup_type: ById(57689d15-57f5-498e-ba97-26ce1fb9565d) } result = Ok(()) saga_id = 3a2cc205-8e46-4a62-9681-f6159ba06aaf saga_name = start-instance-update saga_node = LockInstance
66622024-09-03T23:57:26.123ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 57689d15-57f5-498e-ba97-26ce1fb9565d saga_id = 3a2cc205-8e46-4a62-9681-f6159ba06aaf saga_name = start-instance-update saga_node = LockInstance updater_id = 773273c5-1f6c-46b5-89e1-fbe98cd536a6
66632024-09-03T23:57:26.123ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 3a2cc205-8e46-4a62-9681-f6159ba06aaf saga_name = start-instance-update saga_node = LockInstance
66642024-09-03T23:57:26.123ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 3a2cc205-8e46-4a62-9681-f6159ba06aaf saga_name = start-instance-update saga_node = LockInstance
66652024-09-03T23:57:26.142ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 57689d15-57f5-498e-ba97-26ce1fb9565d saga_id = 3a2cc205-8e46-4a62-9681-f6159ba06aaf saga_name = start-instance-update saga_node = LockInstance updater_id = 773273c5-1f6c-46b5-89e1-fbe98cd536a6
66662024-09-03T23:57:26.142ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 3a2cc205-8e46-4a62-9681-f6159ba06aaf saga_name = start-instance-update saga_node = LockInstance
66672024-09-03T23:57:26.142ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 3a2cc205-8e46-4a62-9681-f6159ba06aaf saga_name = start-instance-update saga_node = LockInstance
66682024-09-03T23:57:26.146ZDEBGnexus (SagaExecutor): instance updater lock acquired! actor_id = 001de000-05e4-4000-8000-000000000002 already_locked = true authenticated = true instance_id = 57689d15-57f5-498e-ba97-26ce1fb9565d locked_gen = Generation(Generation(2)) saga_id = 3a2cc205-8e46-4a62-9681-f6159ba06aaf saga_name = start-instance-update saga_node = LockInstance updater_id = 773273c5-1f6c-46b5-89e1-fbe98cd536a6
66692024-09-03T23:57:26.146ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 5f5ce676-2064-4d97-b873-fbcbc29495de
66702024-09-03T23:57:26.146ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(2), "updater_id": String("773273c5-1f6c-46b5-89e1-fbe98cd536a6")}) node_id = 1 saga_id = 3a2cc205-8e46-4a62-9681-f6159ba06aaf
66712024-09-03T23:57:26.151ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 5f5ce676-2064-4d97-b873-fbcbc29495de
66722024-09-03T23:57:26.151ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 3a2cc205-8e46-4a62-9681-f6159ba06aaf
66732024-09-03T23:57:26.163ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 3a2cc205-8e46-4a62-9681-f6159ba06aaf saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
66742024-09-03T23:57:26.163ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 3a2cc205-8e46-4a62-9681-f6159ba06aaf saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
66752024-09-03T23:57:26.164ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 3a2cc205-8e46-4a62-9681-f6159ba06aaf saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
66762024-09-03T23:57:26.164ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 3a2cc205-8e46-4a62-9681-f6159ba06aaf saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
66772024-09-03T23:57:26.166ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 3a2cc205-8e46-4a62-9681-f6159ba06aaf saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
66782024-09-03T23:57:26.166ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 3a2cc205-8e46-4a62-9681-f6159ba06aaf saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
66792024-09-03T23:57:26.167ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 3a2cc205-8e46-4a62-9681-f6159ba06aaf saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
66802024-09-03T23:57:26.170ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 8448d8a2-33e4-4746-ac02-db97b8df3ca4, lookup_type: ById(8448d8a2-33e4-4746-ac02-db97b8df3ca4) }, key: d721a24b-8073-44fd-8adc-d541f64a7c20, lookup_type: ById(d721a24b-8073-44fd-8adc-d541f64a7c20) }, key: 57689d15-57f5-498e-ba97-26ce1fb9565d, lookup_type: ById(57689d15-57f5-498e-ba97-26ce1fb9565d) } result = Ok(()) saga_id = 3a2cc205-8e46-4a62-9681-f6159ba06aaf saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
66812024-09-03T23:57:26.170ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 3a2cc205-8e46-4a62-9681-f6159ba06aaf saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
66822024-09-03T23:57:26.170ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 3a2cc205-8e46-4a62-9681-f6159ba06aaf saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
66832024-09-03T23:57:26.181ZINFOnexus (SagaExecutor): instance update: starting real update saga... current.active_vmm = Some(Vmm { id: 48c3ff33-2c5c-416c-b826-70461a3d6db6, time_created: 2024-09-03T23:57:05.299739Z, time_deleted: None, instance_id: 57689d15-57f5-498e-ba97-26ce1fb9565d, sled_id: b281022b-35b2-452e-ad2b-78e12f6ca16a, propolis_ip: V6(Ipv6Network { addr: fd00:1122:3344:101::1:0, prefix: 128 }), propolis_port: SqlU16(12400), runtime: VmmRuntimeState { time_state_updated: 2024-09-03T23:57:25.978338Z, gen: Generation(Generation(8)), state: Destroyed } }) current.migration = None current.runtime_state = InstanceRuntimeState { time_updated: 2024-09-03T23:57:05.421375Z, gen: Generation(Generation(3)), propolis_id: Some(48c3ff33-2c5c-416c-b826-70461a3d6db6), dst_propolis_id: None, migration_id: None, nexus_state: Vmm } current.target_vmm = None file = nexus/src/app/sagas/instance_update/start.rs:180 instance_id = 57689d15-57f5-498e-ba97-26ce1fb9565d saga_id = 3a2cc205-8e46-4a62-9681-f6159ba06aaf saga_name = start-instance-update update.deprovision = true update.destroy_active_vmm = Some(48c3ff33-2c5c-416c-b826-70461a3d6db6 (propolis)) update.destroy_target_vmm = None update.network_config_update = Some(Delete) update.new_runtime_state = InstanceRuntimeState { time_updated: 2024-09-03T23:57:26.181562672Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm }
66842024-09-03T23:57:26.181ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:212 saga_id = be32c538-8b93-4f9f-8c0e-3869c8df4e2e saga_name = instance-update
66852024-09-03T23:57:26.181ZINFOnexus (SEC): saga create dag = {"end_node":13,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,10,null],[8,9,null],[10,11,null],[12,0,null],[11,13,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"instance_update.become_updater","label":"BecomeUpdater","name":"updater_lock"}},{"Constant":{"name":"network_config_update","value":"Delete"}},{"Action":{"action_name":"instance_update.update_network_config","label":"UpdateNetworkConfig","name":"update_network_config"}},{"Action":{"action_name":"instance_update.release_virtual_provisioning","label":"ReleaseVirtualProvisioning","name":"release_virtual_provisioning"}},{"Action":{"action_name":"instance_update.unassign_oximeter_producer","label":"UnassignOximeterProducer","name":"unassign_oximeter_producer"}},{"Action":{"action_name":"instance_update.commit_instance_updates","label":"CommitInstanceUpdates","name":"commit_instance_updates"}},{"Constant":{"name":"destroy_active_vmm_params","value":{"instance_id":"57689d15-57f5-498e-ba97-26ce1fb9565d","serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"vmm_id":"48c3ff33-2c5c-416c-b826-70461a3d6db6"}}},{"SubsagaStart":{"params_node_name":"destroy_active_vmm_params","saga_name":"destroy_active_vmm"}},{"Action":{"action_name":"destroy_vmm.release_sled_resources","label":"ReleaseSledResources","name":"release_sled_resources"}},{"Action":{"action_name":"destroy_vmm.mark_vmm_deleted","label":"MarkVmmDeleted","name":"mark_vmm_deleted"}},{"SubsagaEnd":{"name":"active_vmm_destroyed"}},{"Start":{"params":{"authz_instance":{"key":"57689d15-57f5-498e-ba97-26ce1fb9565d","lookup_type":{"ById":"57689d15-57f5-498e-ba97-26ce1fb9565d"},"parent":{"key":"d721a24b-8073-44fd-8adc-d541f64a7c20","lookup_type":{"ById":"d721a24b-8073-44fd-8adc-d541f64a7c20"},"parent":{"key":"8448d8a2-33e4-4746-ac02-db97b8df3ca4","lookup_type":{"ById":"8448d8a2-33e4-4746-ac02-db97b8df3ca4"},"parent":null}}},"orig_lock":{"locked_gen":2,"updater_id":"773273c5-1f6c-46b5-89e1-fbe98cd536a6"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"update":{"deprovision":{"cpus_diff":2,"project_id":"d721a24b-8073-44fd-8adc-d541f64a7c20","ram_diff":1073741824},"destroy_active_vmm":"48c3ff33-2c5c-416c-b826-70461a3d6db6","destroy_target_vmm":null,"network_config":"Delete","new_runtime":{"dst_propolis_id":null,"gen":4,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_updated":"2024-09-03T23:57:26.181562672Z"}}}}},"End"]},"saga_name":"instance-update","start_node":12} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = be32c538-8b93-4f9f-8c0e-3869c8df4e2e saga_name = instance-update sec_id = 5f5ce676-2064-4d97-b873-fbcbc29495de
66862024-09-03T23:57:26.181ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = be32c538-8b93-4f9f-8c0e-3869c8df4e2e saga_name = instance-update
66872024-09-03T23:57:26.185ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:310 saga_id = be32c538-8b93-4f9f-8c0e-3869c8df4e2e saga_name = instance-update
66882024-09-03T23:57:26.185ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = be32c538-8b93-4f9f-8c0e-3869c8df4e2e saga_name = instance-update sec_id = 5f5ce676-2064-4d97-b873-fbcbc29495de
66892024-09-03T23:57:26.185ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 5f5ce676-2064-4d97-b873-fbcbc29495de
66902024-09-03T23:57:26.185ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = be32c538-8b93-4f9f-8c0e-3869c8df4e2e
66912024-09-03T23:57:26.189ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 5f5ce676-2064-4d97-b873-fbcbc29495de
66922024-09-03T23:57:26.189ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = be32c538-8b93-4f9f-8c0e-3869c8df4e2e
66932024-09-03T23:57:26.192ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 5f5ce676-2064-4d97-b873-fbcbc29495de
66942024-09-03T23:57:26.192ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = be32c538-8b93-4f9f-8c0e-3869c8df4e2e
66952024-09-03T23:57:26.196ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 5f5ce676-2064-4d97-b873-fbcbc29495de
66962024-09-03T23:57:26.196ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("85a4e6bd-0c26-4c57-b347-b0b13692adcd")) node_id = 0 saga_id = be32c538-8b93-4f9f-8c0e-3869c8df4e2e
66972024-09-03T23:57:26.199ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 5f5ce676-2064-4d97-b873-fbcbc29495de
66982024-09-03T23:57:26.199ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = be32c538-8b93-4f9f-8c0e-3869c8df4e2e
66992024-09-03T23:57:26.201ZDEBGnexus (SagaExecutor): instance update: trying to become instance updater... instance_id = 57689d15-57f5-498e-ba97-26ce1fb9565d parent_lock = UpdaterLock { updater_id: 773273c5-1f6c-46b5-89e1-fbe98cd536a6, locked_gen: Generation(Generation(2)) } saga_id = be32c538-8b93-4f9f-8c0e-3869c8df4e2e saga_name = instance-update
67002024-09-03T23:57:26.201ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = be32c538-8b93-4f9f-8c0e-3869c8df4e2e saga_name = instance-update saga_node = BecomeUpdater
67012024-09-03T23:57:26.202ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = be32c538-8b93-4f9f-8c0e-3869c8df4e2e saga_name = instance-update saga_node = BecomeUpdater
67022024-09-03T23:57:26.209ZDEBGnexus (SagaExecutor): inherited lock from 773273c5-1f6c-46b5-89e1-fbe98cd536a6 to 85a4e6bd-0c26-4c57-b347-b0b13692adcd actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 57689d15-57f5-498e-ba97-26ce1fb9565d locked_gen = Generation(Generation(3)) parent_gen = Generation(Generation(2)) parent_id = 773273c5-1f6c-46b5-89e1-fbe98cd536a6 saga_id = be32c538-8b93-4f9f-8c0e-3869c8df4e2e saga_name = instance-update saga_node = BecomeUpdater updater_id = 85a4e6bd-0c26-4c57-b347-b0b13692adcd
67032024-09-03T23:57:26.209ZINFOnexus (SagaExecutor): instance_update: Now, I am become Updater, the destroyer of VMMs. file = nexus/src/app/sagas/instance_update/mod.rs:944 instance_id = 57689d15-57f5-498e-ba97-26ce1fb9565d saga_id = be32c538-8b93-4f9f-8c0e-3869c8df4e2e saga_name = instance-update
67042024-09-03T23:57:26.209ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 5f5ce676-2064-4d97-b873-fbcbc29495de
67052024-09-03T23:57:26.209ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(3), "updater_id": String("85a4e6bd-0c26-4c57-b347-b0b13692adcd")}) node_id = 1 saga_id = be32c538-8b93-4f9f-8c0e-3869c8df4e2e
67062024-09-03T23:57:26.213ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 5f5ce676-2064-4d97-b873-fbcbc29495de
67072024-09-03T23:57:26.213ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = be32c538-8b93-4f9f-8c0e-3869c8df4e2e
67082024-09-03T23:57:26.216ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 5f5ce676-2064-4d97-b873-fbcbc29495de
67092024-09-03T23:57:26.216ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("Delete")) node_id = 2 saga_id = be32c538-8b93-4f9f-8c0e-3869c8df4e2e
67102024-09-03T23:57:26.219ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 5f5ce676-2064-4d97-b873-fbcbc29495de
67112024-09-03T23:57:26.219ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = be32c538-8b93-4f9f-8c0e-3869c8df4e2e
67122024-09-03T23:57:26.222ZINFOnexus (SagaExecutor): instance update: deleting network config file = nexus/src/app/sagas/instance_update/mod.rs:997 instance_id = 57689d15-57f5-498e-ba97-26ce1fb9565d saga_id = be32c538-8b93-4f9f-8c0e-3869c8df4e2e saga_name = instance-update
67132024-09-03T23:57:26.222ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = 57689d15-57f5-498e-ba97-26ce1fb9565d
67142024-09-03T23:57:26.222ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = be32c538-8b93-4f9f-8c0e-3869c8df4e2e saga_name = instance-update saga_node = UpdateNetworkConfig
67152024-09-03T23:57:26.222ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = be32c538-8b93-4f9f-8c0e-3869c8df4e2e saga_name = instance-update saga_node = UpdateNetworkConfig
67162024-09-03T23:57:26.228ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = be32c538-8b93-4f9f-8c0e-3869c8df4e2e saga_name = instance-update saga_node = UpdateNetworkConfig
67172024-09-03T23:57:26.228ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = be32c538-8b93-4f9f-8c0e-3869c8df4e2e saga_name = instance-update saga_node = UpdateNetworkConfig
67182024-09-03T23:57:26.232ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
67192024-09-03T23:57:26.232ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = be32c538-8b93-4f9f-8c0e-3869c8df4e2e saga_name = instance-update saga_node = UpdateNetworkConfig
67202024-09-03T23:57:26.233ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = be32c538-8b93-4f9f-8c0e-3869c8df4e2e saga_name = instance-update saga_node = UpdateNetworkConfig
67212024-09-03T23:57:26.235ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
67222024-09-03T23:57:26.235ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
67232024-09-03T23:57:26.235ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
67242024-09-03T23:57:26.236ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
67252024-09-03T23:57:26.237ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
67262024-09-03T23:57:26.237ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
67272024-09-03T23:57:26.237ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
67282024-09-03T23:57:26.241ZDEBGnexus: notifying dendrite of updates instance_id = Some(57689d15-57f5-498e-ba97-26ce1fb9565d (instance)) switch = switch0
67292024-09-03T23:57:26.242ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b281022b-35b2-452e-ad2b-78e12f6ca16a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b281022b-35b2-452e-ad2b-78e12f6ca16a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1424, tv_nsec: 743542652 } })
67302024-09-03T23:57:26.243ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1050
67312024-09-03T23:57:26.275ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
67322024-09-03T23:57:26.275ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
67332024-09-03T23:57:26.275ZDEBGnexus (MgsClient): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "9d95155f-528b-4cb9-94c4-455c50865881", "content-length": "26", "date": "Tue, 03 Sep 2024 23:57:26 GMT"} })
67342024-09-03T23:57:26.275ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
67352024-09-03T23:57:26.275ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
67362024-09-03T23:57:26.305ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
67372024-09-03T23:57:26.306ZDEBGnexus (DpdClient): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/trigger", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "29035e87-cd9d-4ea8-8002-09dc4a765eef", "content-length": "4", "date": "Tue, 03 Sep 2024 23:57:26 GMT"} })
67382024-09-03T23:57:26.307ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 5f5ce676-2064-4d97-b873-fbcbc29495de
67392024-09-03T23:57:26.307ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = be32c538-8b93-4f9f-8c0e-3869c8df4e2e
67402024-09-03T23:57:26.309ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 5f5ce676-2064-4d97-b873-fbcbc29495de
67412024-09-03T23:57:26.309ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = be32c538-8b93-4f9f-8c0e-3869c8df4e2e
67422024-09-03T23:57:26.317ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = be32c538-8b93-4f9f-8c0e-3869c8df4e2e saga_name = instance-update saga_node = ReleaseVirtualProvisioning
67432024-09-03T23:57:26.318ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = be32c538-8b93-4f9f-8c0e-3869c8df4e2e saga_name = instance-update saga_node = ReleaseVirtualProvisioning
67442024-09-03T23:57:26.332ZINFOnexus (SagaExecutor): instance update (no VMM): deallocated virtual provisioning resources file = nexus/src/app/sagas/instance_update/mod.rs:1072 instance_id = 57689d15-57f5-498e-ba97-26ce1fb9565d records_deleted = [VirtualProvisioningCollection { id: 001de000-1334-4000-8000-000000000000, time_modified: Some(2024-09-03T23:57:26.323521Z), collection_type: "Fleet", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 8448d8a2-33e4-4746-ac02-db97b8df3ca4, time_modified: Some(2024-09-03T23:57:26.323521Z), collection_type: "Silo", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: d721a24b-8073-44fd-8adc-d541f64a7c20, time_modified: Some(2024-09-03T23:57:26.323521Z), collection_type: "Project", virtual_disk_bytes_provisioned: ByteCount(ByteCount(2147483648)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }] saga_id = be32c538-8b93-4f9f-8c0e-3869c8df4e2e saga_name = instance-update
67452024-09-03T23:57:26.332ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 5f5ce676-2064-4d97-b873-fbcbc29495de
67462024-09-03T23:57:26.332ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = be32c538-8b93-4f9f-8c0e-3869c8df4e2e
67472024-09-03T23:57:26.335ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 5f5ce676-2064-4d97-b873-fbcbc29495de
67482024-09-03T23:57:26.335ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = be32c538-8b93-4f9f-8c0e-3869c8df4e2e
67492024-09-03T23:57:26.338ZINFOnexus (SagaExecutor): instance update (no VMM): unassigning oximeter producer file = nexus/src/app/sagas/instance_update/mod.rs:1107 instance_id = 57689d15-57f5-498e-ba97-26ce1fb9565d saga_id = be32c538-8b93-4f9f-8c0e-3869c8df4e2e saga_name = instance-update
67502024-09-03T23:57:26.338ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = be32c538-8b93-4f9f-8c0e-3869c8df4e2e saga_name = instance-update saga_node = UnassignOximeterProducer
67512024-09-03T23:57:26.338ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = be32c538-8b93-4f9f-8c0e-3869c8df4e2e saga_name = instance-update saga_node = UnassignOximeterProducer
67522024-09-03T23:57:26.345ZDEBGnexus (SagaExecutor): deleted metric producer assignment collector_id = 022d3a36-e465-40ec-b1ab-e6f9700e76c8 producer_id = 57689d15-57f5-498e-ba97-26ce1fb9565d saga_id = be32c538-8b93-4f9f-8c0e-3869c8df4e2e saga_name = instance-update
67532024-09-03T23:57:26.345ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = be32c538-8b93-4f9f-8c0e-3869c8df4e2e saga_name = instance-update saga_node = UnassignOximeterProducer
67542024-09-03T23:57:26.345ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = be32c538-8b93-4f9f-8c0e-3869c8df4e2e saga_name = instance-update saga_node = UnassignOximeterProducer
67552024-09-03T23:57:26.378ZINFOnexus (SagaExecutor): registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 57689d15-57f5-498e-ba97-26ce1fb9565d saga_id = be32c538-8b93-4f9f-8c0e-3869c8df4e2e saga_name = instance-update
67562024-09-03T23:57:26.378ZDEBGnexus (SagaExecutor): client request body = None method = DELETE oximeter-collector = 57689d15-57f5-498e-ba97-26ce1fb9565d saga_id = be32c538-8b93-4f9f-8c0e-3869c8df4e2e saga_name = instance-update uri = http://[fd00:1122:3344:101::d]:12223/producers/57689d15-57f5-498e-ba97-26ce1fb9565d
67572024-09-03T23:57:26.382ZDEBGnexus (SagaExecutor): client response oximeter-collector = 57689d15-57f5-498e-ba97-26ce1fb9565d result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers/57689d15-57f5-498e-ba97-26ce1fb9565d", query: None, fragment: None }, status: 204, headers: {"x-request-id": "077991ca-db41-4f67-a2ae-994277c9bd33", "date": "Tue, 03 Sep 2024 23:57:26 GMT"} }) saga_id = be32c538-8b93-4f9f-8c0e-3869c8df4e2e saga_name = instance-update
67582024-09-03T23:57:26.382ZDEBGnexus (SagaExecutor): successfully deleted producer from collector address = [fd00:1122:3344:101::d]:12223 collector_id = 022d3a36-e465-40ec-b1ab-e6f9700e76c8 producer_id = 57689d15-57f5-498e-ba97-26ce1fb9565d saga_id = be32c538-8b93-4f9f-8c0e-3869c8df4e2e saga_name = instance-update
67592024-09-03T23:57:26.383ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 5f5ce676-2064-4d97-b873-fbcbc29495de
67602024-09-03T23:57:26.383ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = be32c538-8b93-4f9f-8c0e-3869c8df4e2e
67612024-09-03T23:57:26.387ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 5f5ce676-2064-4d97-b873-fbcbc29495de
67622024-09-03T23:57:26.387ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = be32c538-8b93-4f9f-8c0e-3869c8df4e2e
67632024-09-03T23:57:26.391ZDEBGnexus (SagaExecutor): instance update: committing new runtime state and unlocking... instance_id = 57689d15-57f5-498e-ba97-26ce1fb9565d lock = UpdaterLock { updater_id: 85a4e6bd-0c26-4c57-b347-b0b13692adcd, locked_gen: Generation(Generation(3)) } new_runtime = InstanceRuntimeState { time_updated: 2024-09-03T23:57:26.181562672Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm } saga_id = be32c538-8b93-4f9f-8c0e-3869c8df4e2e saga_name = instance-update
67642024-09-03T23:57:26.391ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = be32c538-8b93-4f9f-8c0e-3869c8df4e2e saga_name = instance-update saga_node = CommitInstanceUpdates
67652024-09-03T23:57:26.391ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = be32c538-8b93-4f9f-8c0e-3869c8df4e2e saga_name = instance-update saga_node = CommitInstanceUpdates
67662024-09-03T23:57:26.430ZINFOnexus (SagaExecutor): instance update: committed update new runtime state! did_unlock = true file = nexus/src/app/sagas/instance_update/mod.rs:1156 instance_id = 57689d15-57f5-498e-ba97-26ce1fb9565d new_runtime = InstanceRuntimeState { time_updated: 2024-09-03T23:57:26.181562672Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm } saga_id = be32c538-8b93-4f9f-8c0e-3869c8df4e2e saga_name = instance-update
67672024-09-03T23:57:26.430ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = be32c538-8b93-4f9f-8c0e-3869c8df4e2e saga_name = instance-update saga_node = CommitInstanceUpdates
67682024-09-03T23:57:26.430ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 13 reason = Signaled
67692024-09-03T23:57:26.430ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
67702024-09-03T23:57:26.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67712024-09-03T23:57:26.430ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = be32c538-8b93-4f9f-8c0e-3869c8df4e2e saga_name = instance-update saga_node = CommitInstanceUpdates
67722024-09-03T23:57:26.430ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 13 reason = Signaled
67732024-09-03T23:57:26.430ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67742024-09-03T23:57:26.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67752024-09-03T23:57:26.432ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = be32c538-8b93-4f9f-8c0e-3869c8df4e2e saga_name = instance-update saga_node = CommitInstanceUpdates
67762024-09-03T23:57:26.432ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = be32c538-8b93-4f9f-8c0e-3869c8df4e2e saga_name = instance-update saga_node = CommitInstanceUpdates
67772024-09-03T23:57:26.433ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67782024-09-03T23:57:26.434ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = be32c538-8b93-4f9f-8c0e-3869c8df4e2e saga_name = instance-update saga_node = CommitInstanceUpdates
67792024-09-03T23:57:26.434ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = be32c538-8b93-4f9f-8c0e-3869c8df4e2e saga_name = instance-update saga_node = CommitInstanceUpdates
67802024-09-03T23:57:26.434ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
67812024-09-03T23:57:26.434ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67822024-09-03T23:57:26.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67832024-09-03T23:57:26.435ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = be32c538-8b93-4f9f-8c0e-3869c8df4e2e saga_name = instance-update saga_node = CommitInstanceUpdates
67842024-09-03T23:57:26.436ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67852024-09-03T23:57:26.439ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 8448d8a2-33e4-4746-ac02-db97b8df3ca4, lookup_type: ById(8448d8a2-33e4-4746-ac02-db97b8df3ca4) }, key: d721a24b-8073-44fd-8adc-d541f64a7c20, lookup_type: ById(d721a24b-8073-44fd-8adc-d541f64a7c20) }, key: 57689d15-57f5-498e-ba97-26ce1fb9565d, lookup_type: ById(57689d15-57f5-498e-ba97-26ce1fb9565d) } result = Ok(()) saga_id = be32c538-8b93-4f9f-8c0e-3869c8df4e2e saga_name = instance-update saga_node = CommitInstanceUpdates
67862024-09-03T23:57:26.439ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = be32c538-8b93-4f9f-8c0e-3869c8df4e2e saga_name = instance-update saga_node = CommitInstanceUpdates
67872024-09-03T23:57:26.439ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
67882024-09-03T23:57:26.439ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67892024-09-03T23:57:26.439ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = be32c538-8b93-4f9f-8c0e-3869c8df4e2e saga_name = instance-update saga_node = CommitInstanceUpdates
67902024-09-03T23:57:26.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67912024-09-03T23:57:26.444ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 5f5ce676-2064-4d97-b873-fbcbc29495de
67922024-09-03T23:57:26.444ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = be32c538-8b93-4f9f-8c0e-3869c8df4e2e
67932024-09-03T23:57:26.447ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 5f5ce676-2064-4d97-b873-fbcbc29495de
67942024-09-03T23:57:26.447ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = be32c538-8b93-4f9f-8c0e-3869c8df4e2e
67952024-09-03T23:57:26.451ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 5f5ce676-2064-4d97-b873-fbcbc29495de
67962024-09-03T23:57:26.451ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"instance_id": String("57689d15-57f5-498e-ba97-26ce1fb9565d"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("48c3ff33-2c5c-416c-b826-70461a3d6db6")}) node_id = 7 saga_id = be32c538-8b93-4f9f-8c0e-3869c8df4e2e
67972024-09-03T23:57:26.454ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 5f5ce676-2064-4d97-b873-fbcbc29495de
67982024-09-03T23:57:26.454ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = be32c538-8b93-4f9f-8c0e-3869c8df4e2e
67992024-09-03T23:57:26.457ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 5f5ce676-2064-4d97-b873-fbcbc29495de
68002024-09-03T23:57:26.457ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = be32c538-8b93-4f9f-8c0e-3869c8df4e2e
68012024-09-03T23:57:26.474ZDEBGnexus (BackgroundTasks): client request SledAgent = b281022b-35b2-452e-ad2b-78e12f6ca16a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
68022024-09-03T23:57:26.474ZDEBGnexus (BackgroundTasks): client response SledAgent = b281022b-35b2-452e-ad2b-78e12f6ca16a background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "16c74849-546a-462a-8364-7754dc4d04c6", "content-length": "372", "date": "Tue, 03 Sep 2024 23:57:26 GMT"} })
68032024-09-03T23:57:26.475ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68042024-09-03T23:57:26.475ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68052024-09-03T23:57:26.477ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68062024-09-03T23:57:26.477ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68072024-09-03T23:57:26.478ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 5f5ce676-2064-4d97-b873-fbcbc29495de
68082024-09-03T23:57:26.478ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = be32c538-8b93-4f9f-8c0e-3869c8df4e2e
68092024-09-03T23:57:26.479ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68102024-09-03T23:57:26.480ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68112024-09-03T23:57:26.481ZINFOnexus (SagaExecutor): instance update (VMM destroyed): deallocating sled resource reservation file = nexus/src/app/sagas/instance_update/destroyed.rs:83 instance_id = 57689d15-57f5-498e-ba97-26ce1fb9565d propolis_id = 48c3ff33-2c5c-416c-b826-70461a3d6db6 saga_id = be32c538-8b93-4f9f-8c0e-3869c8df4e2e saga_name = instance-update
68122024-09-03T23:57:26.481ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = be32c538-8b93-4f9f-8c0e-3869c8df4e2e saga_name = instance-update saga_node = ReleaseSledResources
68132024-09-03T23:57:26.481ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = be32c538-8b93-4f9f-8c0e-3869c8df4e2e saga_name = instance-update saga_node = ReleaseSledResources
68142024-09-03T23:57:26.483ZDEBGnexus (BackgroundTasks): client request SledAgent = b281022b-35b2-452e-ad2b-78e12f6ca16a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
68152024-09-03T23:57:26.483ZDEBGnexus (BackgroundTasks): client response SledAgent = b281022b-35b2-452e-ad2b-78e12f6ca16a background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "800da40c-e821-45ff-811f-c0711a026400", "date": "Tue, 03 Sep 2024 23:57:26 GMT"} })
68162024-09-03T23:57:26.485ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 54.399651ms iteration = 13 status = {}
68172024-09-03T23:57:26.489ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 5f5ce676-2064-4d97-b873-fbcbc29495de
68182024-09-03T23:57:26.489ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = be32c538-8b93-4f9f-8c0e-3869c8df4e2e
68192024-09-03T23:57:26.492ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 5f5ce676-2064-4d97-b873-fbcbc29495de
68202024-09-03T23:57:26.492ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = be32c538-8b93-4f9f-8c0e-3869c8df4e2e
68212024-09-03T23:57:26.498ZINFOnexus (SagaExecutor): instance update (VMM destroyed): marking VMM record deleted file = nexus/src/app/sagas/instance_update/destroyed.rs:114 instance_id = 57689d15-57f5-498e-ba97-26ce1fb9565d propolis_id = 48c3ff33-2c5c-416c-b826-70461a3d6db6 saga_id = be32c538-8b93-4f9f-8c0e-3869c8df4e2e saga_name = instance-update
68222024-09-03T23:57:26.498ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = be32c538-8b93-4f9f-8c0e-3869c8df4e2e saga_name = instance-update saga_node = MarkVmmDeleted
68232024-09-03T23:57:26.498ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = be32c538-8b93-4f9f-8c0e-3869c8df4e2e saga_name = instance-update saga_node = MarkVmmDeleted
68242024-09-03T23:57:26.523ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
68252024-09-03T23:57:26.524ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
68262024-09-03T23:57:26.532ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 5f5ce676-2064-4d97-b873-fbcbc29495de
68272024-09-03T23:57:26.532ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = be32c538-8b93-4f9f-8c0e-3869c8df4e2e
68282024-09-03T23:57:26.535ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 5f5ce676-2064-4d97-b873-fbcbc29495de
68292024-09-03T23:57:26.535ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = be32c538-8b93-4f9f-8c0e-3869c8df4e2e
68302024-09-03T23:57:26.539ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 5f5ce676-2064-4d97-b873-fbcbc29495de
68312024-09-03T23:57:26.539ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = be32c538-8b93-4f9f-8c0e-3869c8df4e2e
68322024-09-03T23:57:26.543ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 5f5ce676-2064-4d97-b873-fbcbc29495de
68332024-09-03T23:57:26.543ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = be32c538-8b93-4f9f-8c0e-3869c8df4e2e
68342024-09-03T23:57:26.546ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 5f5ce676-2064-4d97-b873-fbcbc29495de
68352024-09-03T23:57:26.546ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = be32c538-8b93-4f9f-8c0e-3869c8df4e2e
68362024-09-03T23:57:26.549ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = be32c538-8b93-4f9f-8c0e-3869c8df4e2e sec_id = 5f5ce676-2064-4d97-b873-fbcbc29495de
68372024-09-03T23:57:26.549ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = be32c538-8b93-4f9f-8c0e-3869c8df4e2e
68382024-09-03T23:57:26.557ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
68392024-09-03T23:57:26.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
68402024-09-03T23:57:26.558ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68412024-09-03T23:57:26.561ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
68422024-09-03T23:57:26.561ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
68432024-09-03T23:57:26.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
68442024-09-03T23:57:26.562ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68452024-09-03T23:57:26.564ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
68462024-09-03T23:57:26.564ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
68472024-09-03T23:57:26.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
68482024-09-03T23:57:26.592ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = be32c538-8b93-4f9f-8c0e-3869c8df4e2e saga_name = instance-update sec_id = 5f5ce676-2064-4d97-b873-fbcbc29495de
68492024-09-03T23:57:26.592ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:361 saga_id = be32c538-8b93-4f9f-8c0e-3869c8df4e2e saga_name = instance-update saga_result = SagaResult { saga_id: be32c538-8b93-4f9f-8c0e-3869c8df4e2e, saga_log: SagaLog { saga_id: be32c538-8b93-4f9f-8c0e-3869c8df4e2e, unwinding: false, events: [N012 started, N012 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N013 started, N013 succeeded], node_status: {0: Succeeded(String("85a4e6bd-0c26-4c57-b347-b0b13692adcd")), 1: Succeeded(Object {"locked_gen": Number(3), "updater_id": String("85a4e6bd-0c26-4c57-b347-b0b13692adcd")}), 2: Succeeded(String("Delete")), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Object {"instance_id": String("57689d15-57f5-498e-ba97-26ce1fb9565d"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("48c3ff33-2c5c-416c-b826-70461a3d6db6")}), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"active_vmm_destroyed": Null, "commit_instance_updates": Null, "destroy_active_vmm_params": Object {"instance_id": String("57689d15-57f5-498e-ba97-26ce1fb9565d"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("48c3ff33-2c5c-416c-b826-70461a3d6db6")}, "mark_vmm_deleted": Null, "network_config_update": String("Delete"), "release_sled_resources": Null, "release_virtual_provisioning": Null, "saga_instance_lock_id": String("85a4e6bd-0c26-4c57-b347-b0b13692adcd"), "unassign_oximeter_producer": Null, "update_network_config": Null, "updater_lock": Object {"locked_gen": Number(3), "updater_id": String("85a4e6bd-0c26-4c57-b347-b0b13692adcd")}} }) }
68502024-09-03T23:57:26.592ZDEBGnexus (SagaExecutor): instance update: child saga completed successfully child_saga_id = be32c538-8b93-4f9f-8c0e-3869c8df4e2e instance_id = 57689d15-57f5-498e-ba97-26ce1fb9565d saga_id = 3a2cc205-8e46-4a62-9681-f6159ba06aaf saga_name = start-instance-update
68512024-09-03T23:57:26.592ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 5f5ce676-2064-4d97-b873-fbcbc29495de
68522024-09-03T23:57:26.592ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = 3a2cc205-8e46-4a62-9681-f6159ba06aaf
68532024-09-03T23:57:26.596ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 5f5ce676-2064-4d97-b873-fbcbc29495de
68542024-09-03T23:57:26.596ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 3a2cc205-8e46-4a62-9681-f6159ba06aaf
68552024-09-03T23:57:26.599ZDEBGnexus (BackgroundTasks): client request SledAgent = b281022b-35b2-452e-ad2b-78e12f6ca16a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
68562024-09-03T23:57:26.599ZDEBGnexus (BackgroundTasks): client response SledAgent = b281022b-35b2-452e-ad2b-78e12f6ca16a background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "bd9cfc18-0aa6-4c24-8f82-007f86e76e17", "content-length": "691", "date": "Tue, 03 Sep 2024 23:57:26 GMT"} })
68572024-09-03T23:57:26.600ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
68582024-09-03T23:57:26.600ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
68592024-09-03T23:57:26.600ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
68602024-09-03T23:57:26.600ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 5f5ce676-2064-4d97-b873-fbcbc29495de
68612024-09-03T23:57:26.600ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 3a2cc205-8e46-4a62-9681-f6159ba06aaf
68622024-09-03T23:57:26.600ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 170.456581ms iteration = 13 status = {}
68632024-09-03T23:57:26.603ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 3a2cc205-8e46-4a62-9681-f6159ba06aaf sec_id = 5f5ce676-2064-4d97-b873-fbcbc29495de
68642024-09-03T23:57:26.603ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 3a2cc205-8e46-4a62-9681-f6159ba06aaf
68652024-09-03T23:57:26.610ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 3a2cc205-8e46-4a62-9681-f6159ba06aaf saga_name = start-instance-update sec_id = 5f5ce676-2064-4d97-b873-fbcbc29495de
68662024-09-03T23:57:26.610ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:361 saga_id = 3a2cc205-8e46-4a62-9681-f6159ba06aaf saga_name = start-instance-update saga_result = SagaResult { saga_id: 3a2cc205-8e46-4a62-9681-f6159ba06aaf, saga_log: SagaLog { saga_id: 3a2cc205-8e46-4a62-9681-f6159ba06aaf, unwinding: false, events: [N003 started, N003 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N004 started, N004 succeeded], node_status: {0: Succeeded(String("773273c5-1f6c-46b5-89e1-fbe98cd536a6")), 1: Succeeded(Object {"locked_gen": Number(2), "updater_id": String("773273c5-1f6c-46b5-89e1-fbe98cd536a6")}), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"saga_instance_lock_id": String("773273c5-1f6c-46b5-89e1-fbe98cd536a6"), "state": Null, "updater_lock": Object {"locked_gen": Number(2), "updater_id": String("773273c5-1f6c-46b5-89e1-fbe98cd536a6")}} }) }
68672024-09-03T23:57:26.857ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50060 req_id = 0c918b9d-f00e-4de7-b55a-0f9f3ceac9fc roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/11?limit=100
68682024-09-03T23:57:26.857ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50060 req_id = 0c918b9d-f00e-4de7-b55a-0f9f3ceac9fc resource = Database result = Ok(()) uri = /nat/ipv4/changeset/11?limit=100
68692024-09-03T23:57:26.860ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2686 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50060 req_id = 0c918b9d-f00e-4de7-b55a-0f9f3ceac9fc response_code = 200 uri = /nat/ipv4/changeset/11?limit=100
68702024-09-03T23:57:26.984ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = ae781911-40c4-4532-9521-5af99f806c9b roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
68712024-09-03T23:57:26.985ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = ae781911-40c4-4532-9521-5af99f806c9b resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
68722024-09-03T23:57:26.986ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1764 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = ae781911-40c4-4532-9521-5af99f806c9b response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
68732024-09-03T23:57:28.007ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 6d3284ad-d442-47f3-82cd-56f44a63a756 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
68742024-09-03T23:57:28.007ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 6d3284ad-d442-47f3-82cd-56f44a63a756 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
68752024-09-03T23:57:28.009ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1833 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 6d3284ad-d442-47f3-82cd-56f44a63a756 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
68762024-09-03T23:57:29.031ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = d10be02a-87f6-4934-b8df-5bbb5a33740d roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
68772024-09-03T23:57:29.031ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = d10be02a-87f6-4934-b8df-5bbb5a33740d resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
68782024-09-03T23:57:29.033ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2307 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = d10be02a-87f6-4934-b8df-5bbb5a33740d response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
68792024-09-03T23:57:29.245ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 36 reason = Timeout
68802024-09-03T23:57:29.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68812024-09-03T23:57:29.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68822024-09-03T23:57:29.247ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68832024-09-03T23:57:29.249ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
68842024-09-03T23:57:29.250ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68852024-09-03T23:57:29.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68862024-09-03T23:57:29.251ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 36 reason = Timeout
68872024-09-03T23:57:29.251ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
68882024-09-03T23:57:29.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
68892024-09-03T23:57:29.251ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68902024-09-03T23:57:29.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68912024-09-03T23:57:29.253ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
68922024-09-03T23:57:29.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
68932024-09-03T23:57:29.253ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68942024-09-03T23:57:29.255ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.895084ms iteration = 36 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
68952024-09-03T23:57:29.256ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b1196b3e-aa3c-4486-a0ad-52f372819a8f, lookup_type: ById(b1196b3e-aa3c-4486-a0ad-52f372819a8f) } result = Ok(())
68962024-09-03T23:57:29.256ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68972024-09-03T23:57:29.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68982024-09-03T23:57:29.261ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b1196b3e-aa3c-4486-a0ad-52f372819a8f original_time_created = 2024-09-03 23:51:19.204380 UTC target_id = b1196b3e-aa3c-4486-a0ad-52f372819a8f time_created = 2024-09-03 23:51:19.204380 UTC
68992024-09-03T23:57:29.261ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 15.705029ms iteration = 36 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b1196b3e-aa3c-4486-a0ad-52f372819a8f","time_created":"2024-09-03T23:51:19.204380Z"}
69002024-09-03T23:57:29.880ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 631 local_addr = [fd00:1122:3344:101::c]:59395 method = GET remote_addr = [fd00:1122:3344:101::d]:55949 req_id = e7b1f057-a37d-48e7-bb7c-83c89e7e0411 response_code = 200 uri = /5f5ce676-2064-4d97-b873-fbcbc29495de
69012024-09-03T23:57:30.053ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = f13d7bc3-5f40-4070-955e-9a36ae1dd2b0 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
69022024-09-03T23:57:30.053ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = f13d7bc3-5f40-4070-955e-9a36ae1dd2b0 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
69032024-09-03T23:57:30.055ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2077 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = f13d7bc3-5f40-4070-955e-9a36ae1dd2b0 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
69042024-09-03T23:57:31.075ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = de2cd668-c5bd-4610-ade6-de10d28673e0 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
69052024-09-03T23:57:31.075ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = de2cd668-c5bd-4610-ade6-de10d28673e0 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
69062024-09-03T23:57:31.077ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2327 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = de2cd668-c5bd-4610-ade6-de10d28673e0 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
69072024-09-03T23:57:32.096ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 382b9f95-e427-478e-b55f-9203ffb977e5 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
69082024-09-03T23:57:32.096ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 382b9f95-e427-478e-b55f-9203ffb977e5 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
69092024-09-03T23:57:32.098ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2434 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 382b9f95-e427-478e-b55f-9203ffb977e5 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
69102024-09-03T23:57:33.119ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 632c6d2f-f418-4b2f-ba64-04696e1fe9d6 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
69112024-09-03T23:57:33.119ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 632c6d2f-f418-4b2f-ba64-04696e1fe9d6 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
69122024-09-03T23:57:33.121ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3025 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 632c6d2f-f418-4b2f-ba64-04696e1fe9d6 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
69132024-09-03T23:57:34.140ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = f67bd5da-96d7-4032-b47e-4ec07f26f109 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
69142024-09-03T23:57:34.141ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = f67bd5da-96d7-4032-b47e-4ec07f26f109 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
69152024-09-03T23:57:34.142ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1752 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = f67bd5da-96d7-4032-b47e-4ec07f26f109 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
69162024-09-03T23:57:35.161ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 63260506-226c-4800-aad1-4edf42bc445b roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
69172024-09-03T23:57:35.161ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 63260506-226c-4800-aad1-4edf42bc445b resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
69182024-09-03T23:57:35.163ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2327 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 63260506-226c-4800-aad1-4edf42bc445b response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
69192024-09-03T23:57:36.183ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = d3e53ab9-0956-449e-a15f-7e4be5cab0e7 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
69202024-09-03T23:57:36.183ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = d3e53ab9-0956-449e-a15f-7e4be5cab0e7 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
69212024-09-03T23:57:36.185ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2519 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = d3e53ab9-0956-449e-a15f-7e4be5cab0e7 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
69222024-09-03T23:57:37.205ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = eb598de1-a728-40ef-bcb7-46a7a90f73fe roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
69232024-09-03T23:57:37.205ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = eb598de1-a728-40ef-bcb7-46a7a90f73fe resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
69242024-09-03T23:57:37.207ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2447 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = eb598de1-a728-40ef-bcb7-46a7a90f73fe response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
69252024-09-03T23:57:38.228ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 703c758a-af83-4c12-a3b0-98d3c63e410f roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
69262024-09-03T23:57:38.228ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 703c758a-af83-4c12-a3b0-98d3c63e410f resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
69272024-09-03T23:57:38.230ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2440 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 703c758a-af83-4c12-a3b0-98d3c63e410f response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
69282024-09-03T23:57:39.245ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 9 reason = Timeout
69292024-09-03T23:57:39.245ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 37 reason = Timeout
69302024-09-03T23:57:39.245ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 7 reason = Timeout
69312024-09-03T23:57:39.245ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 13 reason = Timeout
69322024-09-03T23:57:39.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69332024-09-03T23:57:39.245ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 7 reason = Timeout
69342024-09-03T23:57:39.245ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 9 reason = Timeout
69352024-09-03T23:57:39.245ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 7 reason = Timeout
69362024-09-03T23:57:39.245ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
69372024-09-03T23:57:39.245ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
69382024-09-03T23:57:39.245ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 7 reason = Timeout
69392024-09-03T23:57:39.245ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
69402024-09-03T23:57:39.245ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
69412024-09-03T23:57:39.245ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 8 reason = Timeout
69422024-09-03T23:57:39.245ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = b1196b3e-aa3c-4486-a0ad-52f372819a8f
69432024-09-03T23:57:39.245ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 7 reason = Timeout
69442024-09-03T23:57:39.245ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 16.73\u{b5}s iteration = 8 status = {"enabled":false,"target_id":"b1196b3e-aa3c-4486-a0ad-52f372819a8f"}
69452024-09-03T23:57:39.245ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
69462024-09-03T23:57:39.245ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 13 reason = Timeout
69472024-09-03T23:57:39.245ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 7 reason = Timeout
69482024-09-03T23:57:39.245ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
69492024-09-03T23:57:39.245ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-09-03 23:47:39.245804289 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
69502024-09-03T23:57:39.245ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
69512024-09-03T23:57:39.245ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 13 reason = Timeout
69522024-09-03T23:57:39.245ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
69532024-09-03T23:57:39.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
69542024-09-03T23:57:39.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69552024-09-03T23:57:39.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
69562024-09-03T23:57:39.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
69572024-09-03T23:57:39.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
69582024-09-03T23:57:39.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
69592024-09-03T23:57:39.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
69602024-09-03T23:57:39.246ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1f2af9fb-1e02-483c-afd2-2b8742b46afd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("90a0c753-ce30-4bd3-a374-17c504cb8aee.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("90a0c753-ce30-4bd3-a374-17c504cb8aee.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1437, tv_nsec: 746944031 } })
69612024-09-03T23:57:39.247ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("321ab50f-2ef5-4620-bbd0-13eba6f06554.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("32795d59-c08e-49d2-b2b0-79f550835c9d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a7781486-6706-487a-a86f-e75908a89f03.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("a7781486-6706-487a-a86f-e75908a89f03.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1437, tv_nsec: 747095694 } })
69622024-09-03T23:57:39.247ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 13 reason = Timeout
69632024-09-03T23:57:39.247ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 13 reason = Timeout
69642024-09-03T23:57:39.247ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
69652024-09-03T23:57:39.247ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69662024-09-03T23:57:39.247ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 4 reason = Timeout
69672024-09-03T23:57:39.247ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 7 reason = Timeout
69682024-09-03T23:57:39.247ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
69692024-09-03T23:57:39.247ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
69702024-09-03T23:57:39.247ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
69712024-09-03T23:57:39.247ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 15 reason = Timeout
69722024-09-03T23:57:39.247ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
69732024-09-03T23:57:39.248ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 14 reason = Timeout
69742024-09-03T23:57:39.248ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
69752024-09-03T23:57:39.248ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 13 reason = Timeout
69762024-09-03T23:57:39.248ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
69772024-09-03T23:57:39.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
69782024-09-03T23:57:39.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
69792024-09-03T23:57:39.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
69802024-09-03T23:57:39.248ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
69812024-09-03T23:57:39.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69822024-09-03T23:57:39.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
69832024-09-03T23:57:39.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
69842024-09-03T23:57:39.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
69852024-09-03T23:57:39.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
69862024-09-03T23:57:39.248ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
69872024-09-03T23:57:39.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
69882024-09-03T23:57:39.248ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
69892024-09-03T23:57:39.248ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
69902024-09-03T23:57:39.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
69912024-09-03T23:57:39.248ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
69922024-09-03T23:57:39.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
69932024-09-03T23:57:39.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
69942024-09-03T23:57:39.250ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
69952024-09-03T23:57:39.250ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 7914a70e-2c26-48ce-826e-885b83b72e72 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
69962024-09-03T23:57:39.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
69972024-09-03T23:57:39.250ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
69982024-09-03T23:57:39.250ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 4.707652ms iteration = 7 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
69992024-09-03T23:57:39.250ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 7914a70e-2c26-48ce-826e-885b83b72e72 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
70002024-09-03T23:57:39.250ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
70012024-09-03T23:57:39.250ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 4.925626ms iteration = 7 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
70022024-09-03T23:57:39.251ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 7 reason = Timeout
70032024-09-03T23:57:39.251ZINFOnexus (BackgroundTasks): Abandoned VMM reaper running background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:76
70042024-09-03T23:57:39.251ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
70052024-09-03T23:57:39.251ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 13 reason = Timeout
70062024-09-03T23:57:39.251ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
70072024-09-03T23:57:39.251ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 13 reason = Timeout
70082024-09-03T23:57:39.251ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
70092024-09-03T23:57:39.251ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
70102024-09-03T23:57:39.251ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 14 reason = Timeout
70112024-09-03T23:57:39.251ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70122024-09-03T23:57:39.251ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70132024-09-03T23:57:39.251ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 13 reason = Timeout
70142024-09-03T23:57:39.251ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
70152024-09-03T23:57:39.251ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 7 reason = Timeout
70162024-09-03T23:57:39.251ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
70172024-09-03T23:57:39.251ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 37 reason = Timeout
70182024-09-03T23:57:39.251ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 13 reason = Timeout
70192024-09-03T23:57:39.251ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
70202024-09-03T23:57:39.251ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
70212024-09-03T23:57:39.251ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 13 reason = Timeout
70222024-09-03T23:57:39.251ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
70232024-09-03T23:57:39.251ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 13 reason = Timeout
70242024-09-03T23:57:39.251ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
70252024-09-03T23:57:39.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
70262024-09-03T23:57:39.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
70272024-09-03T23:57:39.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
70282024-09-03T23:57:39.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70292024-09-03T23:57:39.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
70302024-09-03T23:57:39.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
70312024-09-03T23:57:39.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
70322024-09-03T23:57:39.252ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70332024-09-03T23:57:39.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
70342024-09-03T23:57:39.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
70352024-09-03T23:57:39.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
70362024-09-03T23:57:39.253ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b281022b-35b2-452e-ad2b-78e12f6ca16a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b281022b-35b2-452e-ad2b-78e12f6ca16a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1437, tv_nsec: 754437132 } })
70372024-09-03T23:57:39.257ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
70382024-09-03T23:57:39.257ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
70392024-09-03T23:57:39.257ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
70402024-09-03T23:57:39.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
70412024-09-03T23:57:39.257ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
70422024-09-03T23:57:39.257ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70432024-09-03T23:57:39.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70442024-09-03T23:57:39.258ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 12.495199ms iteration = 13 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
70452024-09-03T23:57:39.259ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b281022b-35b2-452e-ad2b-78e12f6ca16a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b281022b-35b2-452e-ad2b-78e12f6ca16a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1437, tv_nsec: 760196166 } })
70462024-09-03T23:57:39.259ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70472024-09-03T23:57:39.260ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
70482024-09-03T23:57:39.260ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70492024-09-03T23:57:39.261ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-09-03 23:47:39.245804289 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
70502024-09-03T23:57:39.261ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 15.851261ms iteration = 7 status = {"expiration":"2024-09-03T23:47:39.245804289Z","pruned":[]}
70512024-09-03T23:57:39.262ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
70522024-09-03T23:57:39.262ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
70532024-09-03T23:57:39.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
70542024-09-03T23:57:39.263ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
70552024-09-03T23:57:39.263ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
70562024-09-03T23:57:39.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
70572024-09-03T23:57:39.269ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70582024-09-03T23:57:39.272ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
70592024-09-03T23:57:39.272ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
70602024-09-03T23:57:39.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
70612024-09-03T23:57:39.275ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70622024-09-03T23:57:39.278ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
70632024-09-03T23:57:39.278ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
70642024-09-03T23:57:39.278ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70652024-09-03T23:57:39.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
70662024-09-03T23:57:39.278ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70672024-09-03T23:57:39.280ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
70682024-09-03T23:57:39.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
70692024-09-03T23:57:39.281ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
70702024-09-03T23:57:39.281ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
70712024-09-03T23:57:39.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
70722024-09-03T23:57:39.282ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
70732024-09-03T23:57:39.285ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70742024-09-03T23:57:39.286ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 37500 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 7914a70e-2c26-48ce-826e-885b83b72e72 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
70752024-09-03T23:57:39.287ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
70762024-09-03T23:57:39.287ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
70772024-09-03T23:57:39.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
70782024-09-03T23:57:39.294ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 42.496515ms iteration = 7 status = {"errors":[],"found_port_ok":[]}
70792024-09-03T23:57:39.296ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
70802024-09-03T23:57:39.296ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70812024-09-03T23:57:39.296ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
70822024-09-03T23:57:39.296ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70832024-09-03T23:57:39.299ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
70842024-09-03T23:57:39.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
70852024-09-03T23:57:39.304ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70862024-09-03T23:57:39.308ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
70872024-09-03T23:57:39.308ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70882024-09-03T23:57:39.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70892024-09-03T23:57:39.313ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70902024-09-03T23:57:39.316ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b1196b3e-aa3c-4486-a0ad-52f372819a8f, lookup_type: ById(b1196b3e-aa3c-4486-a0ad-52f372819a8f) } result = Ok(())
70912024-09-03T23:57:39.316ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70922024-09-03T23:57:39.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70932024-09-03T23:57:39.322ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70942024-09-03T23:57:39.324ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
70952024-09-03T23:57:39.324ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
70962024-09-03T23:57:39.325ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
70972024-09-03T23:57:39.329ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
70982024-09-03T23:57:39.329ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
70992024-09-03T23:57:39.331ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b281022b-35b2-452e-ad2b-78e12f6ca16a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b281022b-35b2-452e-ad2b-78e12f6ca16a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1437, tv_nsec: 832373550 } })
71002024-09-03T23:57:39.332ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df
71012024-09-03T23:57:39.337ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:56
71022024-09-03T23:57:39.337ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
71032024-09-03T23:57:39.338ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
71042024-09-03T23:57:39.338ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71052024-09-03T23:57:39.338ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
71062024-09-03T23:57:39.339ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
71072024-09-03T23:57:39.339ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
71082024-09-03T23:57:39.339ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b1196b3e-aa3c-4486-a0ad-52f372819a8f original_time_created = 2024-09-03 23:51:19.204380 UTC target_id = b1196b3e-aa3c-4486-a0ad-52f372819a8f time_created = 2024-09-03 23:51:19.204380 UTC
71092024-09-03T23:57:39.339ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 94.199779ms iteration = 37 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b1196b3e-aa3c-4486-a0ad-52f372819a8f","time_created":"2024-09-03T23:51:19.204380Z"}
71102024-09-03T23:57:39.340ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
71112024-09-03T23:57:39.340ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
71122024-09-03T23:57:39.340ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
71132024-09-03T23:57:39.340ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
71142024-09-03T23:57:39.340ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
71152024-09-03T23:57:39.340ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
71162024-09-03T23:57:39.340ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71172024-09-03T23:57:39.341ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
71182024-09-03T23:57:39.341ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71192024-09-03T23:57:39.341ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
71202024-09-03T23:57:39.341ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
71212024-09-03T23:57:39.341ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 90.435988ms iteration = 13 status = {"errors":[],"garbage_collect_requested":[]}
71222024-09-03T23:57:39.342ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
71232024-09-03T23:57:39.342ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 91.237144ms iteration = 13 status = {"errors":[],"records_set_to_done":[]}
71242024-09-03T23:57:39.342ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71252024-09-03T23:57:39.342ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
71262024-09-03T23:57:39.342ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
71272024-09-03T23:57:39.342ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 91.518201ms iteration = 7 status = {"error":null,"error_count":0,"found":0,"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0}
71282024-09-03T23:57:39.343ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
71292024-09-03T23:57:39.343ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
71302024-09-03T23:57:39.343ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 95.644449ms iteration = 7 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
71312024-09-03T23:57:39.343ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
71322024-09-03T23:57:39.343ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
71332024-09-03T23:57:39.343ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
71342024-09-03T23:57:39.345ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71352024-09-03T23:57:39.346ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
71362024-09-03T23:57:39.346ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71372024-09-03T23:57:39.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71382024-09-03T23:57:39.346ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
71392024-09-03T23:57:39.346ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71402024-09-03T23:57:39.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71412024-09-03T23:57:39.347ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
71422024-09-03T23:57:39.347ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
71432024-09-03T23:57:39.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
71442024-09-03T23:57:39.348ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 100.496314ms iteration = 13 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
71452024-09-03T23:57:39.349ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71462024-09-03T23:57:39.349ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:56
71472024-09-03T23:57:39.349ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
71482024-09-03T23:57:39.349ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
71492024-09-03T23:57:39.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
71502024-09-03T23:57:39.350ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 102.915326ms iteration = 4 status = {"nsuccess":5}
71512024-09-03T23:57:39.352ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71522024-09-03T23:57:39.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71532024-09-03T23:57:39.353ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71542024-09-03T23:57:39.353ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
71552024-09-03T23:57:39.353ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
71562024-09-03T23:57:39.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
71572024-09-03T23:57:39.357ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
71582024-09-03T23:57:39.357ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
71592024-09-03T23:57:39.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
71602024-09-03T23:57:39.378ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 127.111287ms iteration = 37 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
71612024-09-03T23:57:39.384ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 132.750738ms iteration = 13 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
71622024-09-03T23:57:39.384ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
71632024-09-03T23:57:39.385ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
71642024-09-03T23:57:39.385ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71652024-09-03T23:57:39.386ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71662024-09-03T23:57:39.386ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
71672024-09-03T23:57:39.386ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
71682024-09-03T23:57:39.386ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
71692024-09-03T23:57:39.386ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
71702024-09-03T23:57:39.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
71712024-09-03T23:57:39.388ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71722024-09-03T23:57:39.388ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:56
71732024-09-03T23:57:39.388ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:241 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
71742024-09-03T23:57:39.388ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 137.077202ms iteration = 13 status = {"destroyed_active_vmms":0,"error":null,"failed_active_vmms":0,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
71752024-09-03T23:57:39.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71762024-09-03T23:57:39.391ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71772024-09-03T23:57:39.392ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
71782024-09-03T23:57:39.393ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: b281022b-35b2-452e-ad2b-78e12f6ca16a, lookup_type: ById(b281022b-35b2-452e-ad2b-78e12f6ca16a) } result = Ok(())
71792024-09-03T23:57:39.393ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71802024-09-03T23:57:39.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71812024-09-03T23:57:39.394ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71822024-09-03T23:57:39.394ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
71832024-09-03T23:57:39.394ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 35395b13-f2fe-45cc-ba7e-90fa45dea705 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
71842024-09-03T23:57:39.394ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
71852024-09-03T23:57:39.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
71862024-09-03T23:57:39.395ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
71872024-09-03T23:57:39.395ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 147.521547ms iteration = 13 status = 0
71882024-09-03T23:57:39.396ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71892024-09-03T23:57:39.398ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
71902024-09-03T23:57:39.398ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71912024-09-03T23:57:39.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71922024-09-03T23:57:39.399ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
71932024-09-03T23:57:39.399ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
71942024-09-03T23:57:39.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
71952024-09-03T23:57:39.402ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 35395b13-f2fe-45cc-ba7e-90fa45dea705 dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
71962024-09-03T23:57:39.402ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
71972024-09-03T23:57:39.402ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-09-03 23:51:41.890432 UTC dns_group = internal generation = 1
71982024-09-03T23:57:39.402ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 156.857458ms iteration = 7 status = {"generation":1}
71992024-09-03T23:57:39.403ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
72002024-09-03T23:57:39.403ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
72012024-09-03T23:57:39.403ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "0f3b3e63-028d-4624-8564-1d8494b79d31", "content-length": "26", "date": "Tue, 03 Sep 2024 23:57:39 GMT"} })
72022024-09-03T23:57:39.403ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
72032024-09-03T23:57:39.405ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
72042024-09-03T23:57:39.407ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
72052024-09-03T23:57:39.407ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
72062024-09-03T23:57:39.407ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "671f6824-9d32-499f-a066-6b5ffd9952ae", "content-length": "26", "date": "Tue, 03 Sep 2024 23:57:39 GMT"} })
72072024-09-03T23:57:39.407ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
72082024-09-03T23:57:39.408ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
72092024-09-03T23:57:39.414ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
72102024-09-03T23:57:39.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
72112024-09-03T23:57:39.417ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72122024-09-03T23:57:39.420ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
72132024-09-03T23:57:39.420ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
72142024-09-03T23:57:39.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
72152024-09-03T23:57:39.430ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72162024-09-03T23:57:39.431ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
72172024-09-03T23:57:39.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
72182024-09-03T23:57:39.432ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 181.150231ms iteration = 13 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
72192024-09-03T23:57:39.433ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72202024-09-03T23:57:39.434ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
72212024-09-03T23:57:39.434ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
72222024-09-03T23:57:39.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
72232024-09-03T23:57:39.435ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
72242024-09-03T23:57:39.435ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
72252024-09-03T23:57:39.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
72262024-09-03T23:57:39.437ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
72272024-09-03T23:57:39.437ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 3d837478-6c27-4614-b539-014b54fe9c3e dns_zone_name = oxide.test found_so_far = 0 version = 2
72282024-09-03T23:57:39.437ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
72292024-09-03T23:57:39.437ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72302024-09-03T23:57:39.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
72312024-09-03T23:57:39.438ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
72322024-09-03T23:57:39.438ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
72332024-09-03T23:57:39.439ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72342024-09-03T23:57:39.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
72352024-09-03T23:57:39.442ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
72362024-09-03T23:57:39.442ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
72372024-09-03T23:57:39.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
72382024-09-03T23:57:39.445ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 3d837478-6c27-4614-b539-014b54fe9c3e dns_zone_name = oxide.test found_so_far = 1 version = 2
72392024-09-03T23:57:39.445ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
72402024-09-03T23:57:39.445ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-09-03 23:51:42.685737 UTC dns_group = external generation = 2
72412024-09-03T23:57:39.445ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 199.746642ms iteration = 7 status = {"generation":2}
72422024-09-03T23:57:39.446ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 198.360141ms iteration = 15 status = {"physical_disks_added":0}
72432024-09-03T23:57:39.462ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df zone_address = fd00:1122:3344:101::2
72442024-09-03T23:57:39.462ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
72452024-09-03T23:57:39.463ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "64a6f926-da6d-4bee-95ce-271518581c36", "content-length": "26", "date": "Tue, 03 Sep 2024 23:57:39 GMT"} })
72462024-09-03T23:57:39.463ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
72472024-09-03T23:57:39.464ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:480 pruned_instances = 1 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
72482024-09-03T23:57:39.464ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 213.272503ms iteration = 13 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":1,"total_instances":0,"update_sagas_queued":0}
72492024-09-03T23:57:39.465ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df
72502024-09-03T23:57:39.467ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-09-03T23:51:37.486746Z, time_modified: 2024-09-03T23:51:37.486746Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 8448d8a2-33e4-4746-ac02-db97b8df3ca4, db_silo: Silo { identity: SiloIdentity { id: 8448d8a2-33e4-4746-ac02-db97b8df3ca4, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-09-03T23:51:42.648012Z, time_modified: 2024-09-03T23:51:42.648012Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "294cc86510f94c68a456b8ade6786c3fe5efad002008ff9982b0149d3f4d8d7a" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 8448d8a2-33e4-4746-ac02-db97b8df3ca4, db_silo: Silo { identity: SiloIdentity { id: 8448d8a2-33e4-4746-ac02-db97b8df3ca4, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-09-03T23:51:42.648012Z, time_modified: 2024-09-03T23:51:42.648012Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "294cc86510f94c68a456b8ade6786c3fe5efad002008ff9982b0149d3f4d8d7a" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
72512024-09-03T23:57:39.467ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 221.51845ms iteration = 7 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"8448d8a2-33e4-4746-ac02-db97b8df3ca4","tls_certs":["294cc86510f94c68a456b8ade6786c3fe5efad002008ff9982b0149d3f4d8d7a"]}},"default_endpoint":{"silo_id":"8448d8a2-33e4-4746-ac02-db97b8df3ca4","tls_certs":["294cc86510f94c68a456b8ade6786c3fe5efad002008ff9982b0149d3f4d8d7a"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
72522024-09-03T23:57:39.555ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
72532024-09-03T23:57:39.555ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "10ae05d1-ef1b-482f-81c6-ca275aa0c01b", "date": "Tue, 03 Sep 2024 23:57:39 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
72542024-09-03T23:57:39.555ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
72552024-09-03T23:57:39.557ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "42a580f4-d74a-45b0-9bad-2fbb8ce14795", "date": "Tue, 03 Sep 2024 23:57:39 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
72562024-09-03T23:57:39.557ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
72572024-09-03T23:57:39.559ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
72582024-09-03T23:57:39.559ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 313.443511ms iteration = 9 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
72592024-09-03T23:57:39.697ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 451.80866ms iteration = 13 status = {}
72602024-09-03T23:57:39.706ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
72612024-09-03T23:57:39.706ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "264694c4-cfe4-486b-b8a1-0634a90528cf", "content-length": "2", "date": "Tue, 03 Sep 2024 23:57:39 GMT"} })
72622024-09-03T23:57:39.709ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
72632024-09-03T23:57:39.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
72642024-09-03T23:57:39.711ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 465.729669ms iteration = 13 status = null
72652024-09-03T23:57:39.716ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
72662024-09-03T23:57:39.718ZDEBGnexus (BackgroundTasks): client request SledAgent = b281022b-35b2-452e-ad2b-78e12f6ca16a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
72672024-09-03T23:57:39.719ZDEBGnexus (BackgroundTasks): client response SledAgent = b281022b-35b2-452e-ad2b-78e12f6ca16a background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "9c57561a-23dd-41f6-8f58-48a2e8ad5ebf", "content-length": "372", "date": "Tue, 03 Sep 2024 23:57:39 GMT"} })
72682024-09-03T23:57:39.719ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72692024-09-03T23:57:39.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72702024-09-03T23:57:39.719ZDEBGnexus (BackgroundTasks): client request SledAgent = b281022b-35b2-452e-ad2b-78e12f6ca16a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
72712024-09-03T23:57:39.719ZDEBGnexus (BackgroundTasks): client response SledAgent = b281022b-35b2-452e-ad2b-78e12f6ca16a background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "31c400a8-c885-4bb4-b679-1b1e74eeff00", "content-length": "691", "date": "Tue, 03 Sep 2024 23:57:39 GMT"} })
72722024-09-03T23:57:39.719ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
72732024-09-03T23:57:39.719ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
72742024-09-03T23:57:39.719ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
72752024-09-03T23:57:39.721ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 473.032407ms iteration = 14 status = {}
72762024-09-03T23:57:39.721ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72772024-09-03T23:57:39.721ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72782024-09-03T23:57:39.724ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72792024-09-03T23:57:39.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72802024-09-03T23:57:39.728ZDEBGnexus (BackgroundTasks): client request SledAgent = b281022b-35b2-452e-ad2b-78e12f6ca16a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
72812024-09-03T23:57:39.763ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
72822024-09-03T23:57:39.766ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "1faa3af5-0c00-43b2-b269-a5c8ed32d4d5", "date": "Tue, 03 Sep 2024 23:57:39 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
72832024-09-03T23:57:39.766ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
72842024-09-03T23:57:39.768ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "4ab27d12-817a-4ca3-ad3a-e698134aa0f0", "date": "Tue, 03 Sep 2024 23:57:39 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
72852024-09-03T23:57:39.768ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
72862024-09-03T23:57:39.771ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "e7de4b0d-8fe8-453b-9408-a2e975470827", "date": "Tue, 03 Sep 2024 23:57:39 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
72872024-09-03T23:57:39.771ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
72882024-09-03T23:57:39.773ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
72892024-09-03T23:57:39.773ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 528.196175ms iteration = 9 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
72902024-09-03T23:57:39.807ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72912024-09-03T23:57:39.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72922024-09-03T23:57:39.809ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: ec64e2ff-6fd0-4ab3-a8fa-a8a710b73297, rack_id: 1d4636f4-828e-412a-8daf-3bda355c92df, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(ccbb015a-58a4-4f0f-8a1a-5716d0b9db06) } rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df switch_location = Switch0
72932024-09-03T23:57:39.809ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72942024-09-03T23:57:39.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72952024-09-03T23:57:39.820ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
72962024-09-03T23:57:39.820ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "7c766ada-ca8c-40f4-a73f-785532b1946c", "content-length": "121", "date": "Tue, 03 Sep 2024 23:57:39 GMT"} })
72972024-09-03T23:57:39.820ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
72982024-09-03T23:57:39.820ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = ccbb015a-58a4-4f0f-8a1a-5716d0b9db06
72992024-09-03T23:57:39.821ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
73002024-09-03T23:57:39.821ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
73012024-09-03T23:57:39.821ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df routes = {}
73022024-09-03T23:57:39.821ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df routes = {}
73032024-09-03T23:57:39.821ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df
73042024-09-03T23:57:39.821ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73052024-09-03T23:57:39.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73062024-09-03T23:57:39.823ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
73072024-09-03T23:57:39.823ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "321664ec-f353-4b6f-b245-316e1550de02", "content-length": "2", "date": "Tue, 03 Sep 2024 23:57:39 GMT"} })
73082024-09-03T23:57:39.823ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
73092024-09-03T23:57:39.823ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "4d577254-ba41-43fa-b6c6-0d89324d0a79", "content-length": "52", "date": "Tue, 03 Sep 2024 23:57:39 GMT"} })
73102024-09-03T23:57:39.823ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df switch_location = Switch0
73112024-09-03T23:57:39.823ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
73122024-09-03T23:57:39.861ZDEBGnexus (BackgroundTasks): client response SledAgent = b281022b-35b2-452e-ad2b-78e12f6ca16a background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "1d1bde9e-3d68-4462-823d-d529df7d907a", "date": "Tue, 03 Sep 2024 23:57:39 GMT"} })
73132024-09-03T23:57:39.864ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 612.858548ms iteration = 14 status = {}
73142024-09-03T23:57:39.881ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 686 local_addr = [fd00:1122:3344:101::c]:59395 method = GET remote_addr = [fd00:1122:3344:101::d]:55949 req_id = 01b21e69-079f-404f-86c2-c6757e2e9259 response_code = 200 uri = /5f5ce676-2064-4d97-b873-fbcbc29495de
73152024-09-03T23:57:39.883ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
73162024-09-03T23:57:39.883ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
73172024-09-03T23:57:39.914ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
73182024-09-03T23:57:39.914ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:37115
73192024-09-03T23:57:39.914ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:37115 req_id = cd0a98f4-6033-421b-b5c4-879ab58e1d52 roles = RoleSet { roles: {} } uri = /metrics/producers
73202024-09-03T23:57:39.914ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:37115 req_id = cd0a98f4-6033-421b-b5c4-879ab58e1d52 resource = Database result = Ok(()) uri = /metrics/producers
73212024-09-03T23:57:39.947ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 022d3a36-e465-40ec-b1ab-e6f9700e76c8
73222024-09-03T23:57:39.947ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:37115 req_id = cd0a98f4-6033-421b-b5c4-879ab58e1d52 roles = RoleSet { roles: {} } uri = /metrics/producers
73232024-09-03T23:57:39.947ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:37115 req_id = cd0a98f4-6033-421b-b5c4-879ab58e1d52 resource = Database result = Ok(()) uri = /metrics/producers
73242024-09-03T23:57:39.959ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "2aed197e-761e-42ae-942c-99e00487fe32", "date": "Tue, 03 Sep 2024 23:57:39 GMT"} })
73252024-09-03T23:57:39.959ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df switch = Switch0
73262024-09-03T23:57:39.959ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
73272024-09-03T23:57:39.960ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c4c1ada1-c868-4b48-97e9-bd58c01cc6b8", "content-length": "667", "date": "Tue, 03 Sep 2024 23:57:39 GMT"} })
73282024-09-03T23:57:39.960ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73292024-09-03T23:57:39.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73302024-09-03T23:57:39.965ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73312024-09-03T23:57:39.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73322024-09-03T23:57:39.972ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73332024-09-03T23:57:39.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73342024-09-03T23:57:39.975ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73352024-09-03T23:57:39.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73362024-09-03T23:57:39.982ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 734.358775ms iteration = 13 status = {}
73372024-09-03T23:57:39.984ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 022d3a36-e465-40ec-b1ab-e6f9700e76c8 uri = http://[fd00:1122:3344:101::d]:12223/producers
73382024-09-03T23:57:39.985ZDEBGnexus: client response oximeter-collector = 022d3a36-e465-40ec-b1ab-e6f9700e76c8 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "914c6952-825c-4553-bad6-ee5fdcc7573f", "date": "Tue, 03 Sep 2024 23:57:39 GMT"} })
73392024-09-03T23:57:39.985ZINFOnexus: assigned collector to new producer collector_id = 022d3a36-e465-40ec-b1ab-e6f9700e76c8 file = nexus/src/app/oximeter.rs:125 producer_id = 5f5ce676-2064-4d97-b873-fbcbc29495de
73402024-09-03T23:57:39.986ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 72084 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:37115 req_id = cd0a98f4-6033-421b-b5c4-879ab58e1d52 response_code = 201 uri = /metrics/producers
73412024-09-03T23:57:39.986ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::c)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, status: 201, headers: {"content-type": "application/json", "x-request-id": "cd0a98f4-6033-421b-b5c4-879ab58e1d52", "content-length": "41", "date": "Tue, 03 Sep 2024 23:57:39 GMT"} })
73422024-09-03T23:57:39.988ZDEBGnexus (producer-registration-task): registered with nexus successfully
73432024-09-03T23:57:39.988ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
73442024-09-03T23:57:40.310ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 4b42837c-6b96-4b7c-8469-0bf4a4c41e46 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
73452024-09-03T23:57:40.311ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 4b42837c-6b96-4b7c-8469-0bf4a4c41e46 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
73462024-09-03T23:57:40.312ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2164 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 4b42837c-6b96-4b7c-8469-0bf4a4c41e46 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
73472024-09-03T23:57:41.331ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = c853e516-8b6f-4f90-8559-0e41fcb40fd4 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
73482024-09-03T23:57:41.332ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = c853e516-8b6f-4f90-8559-0e41fcb40fd4 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
73492024-09-03T23:57:41.334ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2499 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = c853e516-8b6f-4f90-8559-0e41fcb40fd4 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
73502024-09-03T23:57:42.353ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 68bee993-6a52-4bd0-b4ab-ab3b0f3f9d09 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
73512024-09-03T23:57:42.353ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 68bee993-6a52-4bd0-b4ab-ab3b0f3f9d09 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
73522024-09-03T23:57:42.356ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2829 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 68bee993-6a52-4bd0-b4ab-ab3b0f3f9d09 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
73532024-09-03T23:57:43.374ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = a3d3ae7a-77a3-4617-928f-c45f8b125736 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
73542024-09-03T23:57:43.375ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = a3d3ae7a-77a3-4617-928f-c45f8b125736 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
73552024-09-03T23:57:43.377ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2411 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = a3d3ae7a-77a3-4617-928f-c45f8b125736 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
73562024-09-03T23:57:44.396ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 03c1f4b3-a373-4e9e-990e-0ac5ed7e269a roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
73572024-09-03T23:57:44.397ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 03c1f4b3-a373-4e9e-990e-0ac5ed7e269a resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
73582024-09-03T23:57:44.398ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2648 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 03c1f4b3-a373-4e9e-990e-0ac5ed7e269a response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
73592024-09-03T23:57:45.418ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = c027628e-2433-4ce4-bcba-1a7e5536ee1c roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
73602024-09-03T23:57:45.418ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = c027628e-2433-4ce4-bcba-1a7e5536ee1c resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
73612024-09-03T23:57:45.421ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2764 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = c027628e-2433-4ce4-bcba-1a7e5536ee1c response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
73622024-09-03T23:57:46.439ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = e40e1ffb-3417-4c3c-8bbd-b40172050085 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
73632024-09-03T23:57:46.440ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = e40e1ffb-3417-4c3c-8bbd-b40172050085 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
73642024-09-03T23:57:46.441ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2062 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = e40e1ffb-3417-4c3c-8bbd-b40172050085 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
73652024-09-03T23:57:47.463ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = a1524e52-b1dc-4ff1-a352-e412a597af7d roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
73662024-09-03T23:57:47.463ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = a1524e52-b1dc-4ff1-a352-e412a597af7d resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
73672024-09-03T23:57:47.465ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2845 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = a1524e52-b1dc-4ff1-a352-e412a597af7d response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
73682024-09-03T23:57:48.483ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 42ac93ba-9faf-425a-a6ea-38a3c8628e03 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
73692024-09-03T23:57:48.484ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 42ac93ba-9faf-425a-a6ea-38a3c8628e03 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
73702024-09-03T23:57:48.485ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2049 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 42ac93ba-9faf-425a-a6ea-38a3c8628e03 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
73712024-09-03T23:57:49.245ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 38 reason = Timeout
73722024-09-03T23:57:49.246ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73732024-09-03T23:57:49.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73742024-09-03T23:57:49.251ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 38 reason = Timeout
73752024-09-03T23:57:49.251ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
73762024-09-03T23:57:49.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
73772024-09-03T23:57:49.272ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73782024-09-03T23:57:49.275ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
73792024-09-03T23:57:49.275ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73802024-09-03T23:57:49.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73812024-09-03T23:57:49.276ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73822024-09-03T23:57:49.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73832024-09-03T23:57:49.279ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
73842024-09-03T23:57:49.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
73852024-09-03T23:57:49.303ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73862024-09-03T23:57:49.305ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b1196b3e-aa3c-4486-a0ad-52f372819a8f, lookup_type: ById(b1196b3e-aa3c-4486-a0ad-52f372819a8f) } result = Ok(())
73872024-09-03T23:57:49.305ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73882024-09-03T23:57:49.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73892024-09-03T23:57:49.306ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 54.547484ms iteration = 38 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
73902024-09-03T23:57:49.314ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b1196b3e-aa3c-4486-a0ad-52f372819a8f original_time_created = 2024-09-03 23:51:19.204380 UTC target_id = b1196b3e-aa3c-4486-a0ad-52f372819a8f time_created = 2024-09-03 23:51:19.204380 UTC
73912024-09-03T23:57:49.314ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 68.585537ms iteration = 38 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b1196b3e-aa3c-4486-a0ad-52f372819a8f","time_created":"2024-09-03T23:51:19.204380Z"}
73922024-09-03T23:57:49.505ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 80fc94c6-ce13-4923-820c-569572ec0c93 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
73932024-09-03T23:57:49.505ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 80fc94c6-ce13-4923-820c-569572ec0c93 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
73942024-09-03T23:57:49.506ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1646 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 80fc94c6-ce13-4923-820c-569572ec0c93 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
73952024-09-03T23:57:49.986ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 580 local_addr = [fd00:1122:3344:101::c]:59395 method = GET remote_addr = [fd00:1122:3344:101::d]:55949 req_id = 5c03b7b6-8df1-4642-9b27-62adb5215b35 response_code = 200 uri = /5f5ce676-2064-4d97-b873-fbcbc29495de
73962024-09-03T23:57:50.526ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 797a4cdc-229a-46e8-8ef2-cacb4d86d6c1 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
73972024-09-03T23:57:50.526ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 797a4cdc-229a-46e8-8ef2-cacb4d86d6c1 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
73982024-09-03T23:57:50.528ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2412 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 797a4cdc-229a-46e8-8ef2-cacb4d86d6c1 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
73992024-09-03T23:57:51.547ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = fab03ad5-23e4-4b7a-ac31-b90077da6ad9 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
74002024-09-03T23:57:51.548ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = fab03ad5-23e4-4b7a-ac31-b90077da6ad9 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
74012024-09-03T23:57:51.550ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2400 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = fab03ad5-23e4-4b7a-ac31-b90077da6ad9 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
74022024-09-03T23:57:52.568ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = ffc8055b-625e-48d3-a7ca-a9355f01c995 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
74032024-09-03T23:57:52.569ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = ffc8055b-625e-48d3-a7ca-a9355f01c995 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
74042024-09-03T23:57:52.570ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2178 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = ffc8055b-625e-48d3-a7ca-a9355f01c995 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
74052024-09-03T23:57:53.589ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 93ea40fb-4904-47b6-a963-c5730d9cab20 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
74062024-09-03T23:57:53.590ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 93ea40fb-4904-47b6-a963-c5730d9cab20 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
74072024-09-03T23:57:53.592ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2507 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 93ea40fb-4904-47b6-a963-c5730d9cab20 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
74082024-09-03T23:57:54.611ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = e1cf5a32-1640-4f52-aca7-67288d66ab1c roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
74092024-09-03T23:57:54.611ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = e1cf5a32-1640-4f52-aca7-67288d66ab1c resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
74102024-09-03T23:57:54.613ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2388 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = e1cf5a32-1640-4f52-aca7-67288d66ab1c response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
74112024-09-03T23:57:55.633ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = e090d1fa-8270-4f69-b702-02270ddd76fc roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
74122024-09-03T23:57:55.633ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = e090d1fa-8270-4f69-b702-02270ddd76fc resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
74132024-09-03T23:57:55.635ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2484 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = e090d1fa-8270-4f69-b702-02270ddd76fc response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
74142024-09-03T23:57:56.655ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 85966776-921d-4901-8a9b-a29f654bf20b roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
74152024-09-03T23:57:56.656ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 85966776-921d-4901-8a9b-a29f654bf20b resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
74162024-09-03T23:57:56.658ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2548 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 85966776-921d-4901-8a9b-a29f654bf20b response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
74172024-09-03T23:57:56.891ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50060 req_id = 4dcaf8a4-988d-4d42-ae00-60547903e63b roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/11?limit=100
74182024-09-03T23:57:56.892ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50060 req_id = 4dcaf8a4-988d-4d42-ae00-60547903e63b resource = Database result = Ok(()) uri = /nat/ipv4/changeset/11?limit=100
74192024-09-03T23:57:56.895ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3731 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50060 req_id = 4dcaf8a4-988d-4d42-ae00-60547903e63b response_code = 200 uri = /nat/ipv4/changeset/11?limit=100
74202024-09-03T23:57:57.677ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = beca8c04-776b-4846-84eb-6837369f48bb roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
74212024-09-03T23:57:57.677ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = beca8c04-776b-4846-84eb-6837369f48bb resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
74222024-09-03T23:57:57.679ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2575 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = beca8c04-776b-4846-84eb-6837369f48bb response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
74232024-09-03T23:57:58.699ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 27a8a974-029f-4ba7-a742-15b1ea2b4a50 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
74242024-09-03T23:57:58.699ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 27a8a974-029f-4ba7-a742-15b1ea2b4a50 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
74252024-09-03T23:57:58.701ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2470 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 27a8a974-029f-4ba7-a742-15b1ea2b4a50 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
74262024-09-03T23:57:59.245ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 39 reason = Timeout
74272024-09-03T23:57:59.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74282024-09-03T23:57:59.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74292024-09-03T23:57:59.247ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74302024-09-03T23:57:59.250ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
74312024-09-03T23:57:59.250ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74322024-09-03T23:57:59.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74332024-09-03T23:57:59.251ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 39 reason = Timeout
74342024-09-03T23:57:59.251ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
74352024-09-03T23:57:59.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
74362024-09-03T23:57:59.252ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74372024-09-03T23:57:59.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74382024-09-03T23:57:59.253ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
74392024-09-03T23:57:59.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
74402024-09-03T23:57:59.254ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74412024-09-03T23:57:59.255ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.662419ms iteration = 39 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
74422024-09-03T23:57:59.257ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b1196b3e-aa3c-4486-a0ad-52f372819a8f, lookup_type: ById(b1196b3e-aa3c-4486-a0ad-52f372819a8f) } result = Ok(())
74432024-09-03T23:57:59.257ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74442024-09-03T23:57:59.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74452024-09-03T23:57:59.266ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b1196b3e-aa3c-4486-a0ad-52f372819a8f original_time_created = 2024-09-03 23:51:19.204380 UTC target_id = b1196b3e-aa3c-4486-a0ad-52f372819a8f time_created = 2024-09-03 23:51:19.204380 UTC
74462024-09-03T23:57:59.266ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.561553ms iteration = 39 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b1196b3e-aa3c-4486-a0ad-52f372819a8f","time_created":"2024-09-03T23:51:19.204380Z"}
74472024-09-03T23:57:59.722ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 65866e8c-95ac-495b-bb12-a68d33c475f2 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
74482024-09-03T23:57:59.722ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 65866e8c-95ac-495b-bb12-a68d33c475f2 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
74492024-09-03T23:57:59.724ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2162 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 65866e8c-95ac-495b-bb12-a68d33c475f2 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
74502024-09-03T23:57:59.987ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 533 local_addr = [fd00:1122:3344:101::c]:59395 method = GET remote_addr = [fd00:1122:3344:101::d]:55949 req_id = 3b4b83f5-43d0-4bb5-95b0-4e18c8948388 response_code = 200 uri = /5f5ce676-2064-4d97-b873-fbcbc29495de
74512024-09-03T23:58:00.742ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 135ac442-6632-46b7-93ad-790d8bb08743 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
74522024-09-03T23:58:00.743ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 135ac442-6632-46b7-93ad-790d8bb08743 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
74532024-09-03T23:58:00.744ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1815 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 135ac442-6632-46b7-93ad-790d8bb08743 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
74542024-09-03T23:58:01.766ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = cc0e65cc-9c23-46c1-8012-b0f48335db40 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
74552024-09-03T23:58:01.766ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = cc0e65cc-9c23-46c1-8012-b0f48335db40 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
74562024-09-03T23:58:01.768ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3244 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = cc0e65cc-9c23-46c1-8012-b0f48335db40 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
74572024-09-03T23:58:02.786ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = d4027876-3ce8-4213-90b9-5329f70ff8b5 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
74582024-09-03T23:58:02.787ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = d4027876-3ce8-4213-90b9-5329f70ff8b5 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
74592024-09-03T23:58:02.789ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2444 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = d4027876-3ce8-4213-90b9-5329f70ff8b5 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
74602024-09-03T23:58:03.808ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 02409a34-4fc0-4acf-874c-bb5237ab012e roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
74612024-09-03T23:58:03.808ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 02409a34-4fc0-4acf-874c-bb5237ab012e resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
74622024-09-03T23:58:03.810ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2439 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 02409a34-4fc0-4acf-874c-bb5237ab012e response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
74632024-09-03T23:58:04.829ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = aeeb56cc-73bb-455e-85af-4a4be3251fb9 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
74642024-09-03T23:58:04.830ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = aeeb56cc-73bb-455e-85af-4a4be3251fb9 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
74652024-09-03T23:58:04.832ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2419 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = aeeb56cc-73bb-455e-85af-4a4be3251fb9 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
74662024-09-03T23:58:05.852ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 4c82d366-553c-4cb8-b7a7-d4d6fb902906 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
74672024-09-03T23:58:05.852ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 4c82d366-553c-4cb8-b7a7-d4d6fb902906 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
74682024-09-03T23:58:05.854ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2368 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 4c82d366-553c-4cb8-b7a7-d4d6fb902906 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
74692024-09-03T23:58:06.874ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 9b8c85e2-adb6-47b2-9cc1-b9026748cf84 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
74702024-09-03T23:58:06.874ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 9b8c85e2-adb6-47b2-9cc1-b9026748cf84 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
74712024-09-03T23:58:06.876ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2064 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = 9b8c85e2-adb6-47b2-9cc1-b9026748cf84 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
74722024-09-03T23:58:07.895ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = afbe4087-4084-4c3c-aade-4d98feaca8c1 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
74732024-09-03T23:58:07.895ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = afbe4087-4084-4c3c-aade-4d98feaca8c1 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
74742024-09-03T23:58:07.897ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2477 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = afbe4087-4084-4c3c-aade-4d98feaca8c1 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
74752024-09-03T23:58:08.918ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = d1b98f01-69b7-4e15-a55f-c34425d8a569 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
74762024-09-03T23:58:08.919ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = d1b98f01-69b7-4e15-a55f-c34425d8a569 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
74772024-09-03T23:58:08.920ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2289 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = d1b98f01-69b7-4e15-a55f-c34425d8a569 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
74782024-09-03T23:58:09.246ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 14 reason = Timeout
74792024-09-03T23:58:09.246ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 40 reason = Timeout
74802024-09-03T23:58:09.246ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 14 reason = Timeout
74812024-09-03T23:58:09.246ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74822024-09-03T23:58:09.246ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
74832024-09-03T23:58:09.246ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 14 reason = Timeout
74842024-09-03T23:58:09.246ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
74852024-09-03T23:58:09.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
74862024-09-03T23:58:09.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74872024-09-03T23:58:09.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
74882024-09-03T23:58:09.248ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 14 reason = Timeout
74892024-09-03T23:58:09.248ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 14 reason = Timeout
74902024-09-03T23:58:09.248ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74912024-09-03T23:58:09.248ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
74922024-09-03T23:58:09.248ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 16 reason = Timeout
74932024-09-03T23:58:09.248ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 15 reason = Timeout
74942024-09-03T23:58:09.248ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
74952024-09-03T23:58:09.248ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 14 reason = Timeout
74962024-09-03T23:58:09.248ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
74972024-09-03T23:58:09.248ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
74982024-09-03T23:58:09.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
74992024-09-03T23:58:09.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
75002024-09-03T23:58:09.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
75012024-09-03T23:58:09.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75022024-09-03T23:58:09.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
75032024-09-03T23:58:09.249ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b281022b-35b2-452e-ad2b-78e12f6ca16a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b281022b-35b2-452e-ad2b-78e12f6ca16a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1467, tv_nsec: 749428384 } })
75042024-09-03T23:58:09.249ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75052024-09-03T23:58:09.249ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.861794ms iteration = 14 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
75062024-09-03T23:58:09.250ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
75072024-09-03T23:58:09.250ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b281022b-35b2-452e-ad2b-78e12f6ca16a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b281022b-35b2-452e-ad2b-78e12f6ca16a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1467, tv_nsec: 750716042 } })
75082024-09-03T23:58:09.251ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
75092024-09-03T23:58:09.253ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
75102024-09-03T23:58:09.253ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75112024-09-03T23:58:09.253ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 14 reason = Timeout
75122024-09-03T23:58:09.253ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
75132024-09-03T23:58:09.253ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 14 reason = Timeout
75142024-09-03T23:58:09.253ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
75152024-09-03T23:58:09.253ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
75162024-09-03T23:58:09.253ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 15 reason = Timeout
75172024-09-03T23:58:09.253ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
75182024-09-03T23:58:09.253ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 14 reason = Timeout
75192024-09-03T23:58:09.253ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
75202024-09-03T23:58:09.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75212024-09-03T23:58:09.253ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 40 reason = Timeout
75222024-09-03T23:58:09.253ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
75232024-09-03T23:58:09.253ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 14 reason = Timeout
75242024-09-03T23:58:09.253ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 14 reason = Timeout
75252024-09-03T23:58:09.253ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 14 reason = Timeout
75262024-09-03T23:58:09.253ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
75272024-09-03T23:58:09.253ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
75282024-09-03T23:58:09.253ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
75292024-09-03T23:58:09.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
75302024-09-03T23:58:09.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
75312024-09-03T23:58:09.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
75322024-09-03T23:58:09.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
75332024-09-03T23:58:09.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
75342024-09-03T23:58:09.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
75352024-09-03T23:58:09.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
75362024-09-03T23:58:09.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
75372024-09-03T23:58:09.257ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75382024-09-03T23:58:09.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75392024-09-03T23:58:09.259ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
75402024-09-03T23:58:09.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
75412024-09-03T23:58:09.285ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75422024-09-03T23:58:09.287ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
75432024-09-03T23:58:09.287ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
75442024-09-03T23:58:09.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
75452024-09-03T23:58:09.290ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 37.065808ms iteration = 14 status = {"errors":[],"records_set_to_done":[]}
75462024-09-03T23:58:09.293ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75472024-09-03T23:58:09.294ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:56
75482024-09-03T23:58:09.294ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
75492024-09-03T23:58:09.294ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
75502024-09-03T23:58:09.294ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75512024-09-03T23:58:09.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
75522024-09-03T23:58:09.295ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
75532024-09-03T23:58:09.295ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
75542024-09-03T23:58:09.295ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "61ad07f8-54a4-43cc-bde1-ffba3282627f", "content-length": "26", "date": "Tue, 03 Sep 2024 23:58:09 GMT"} })
75552024-09-03T23:58:09.295ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
75562024-09-03T23:58:09.296ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75572024-09-03T23:58:09.297ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
75582024-09-03T23:58:09.297ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75592024-09-03T23:58:09.297ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
75602024-09-03T23:58:09.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75612024-09-03T23:58:09.299ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
75622024-09-03T23:58:09.299ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
75632024-09-03T23:58:09.299ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
75642024-09-03T23:58:09.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
75652024-09-03T23:58:09.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
75662024-09-03T23:58:09.299ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75672024-09-03T23:58:09.299ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
75682024-09-03T23:58:09.299ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
75692024-09-03T23:58:09.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
75702024-09-03T23:58:09.300ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
75712024-09-03T23:58:09.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
75722024-09-03T23:58:09.301ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
75732024-09-03T23:58:09.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
75742024-09-03T23:58:09.302ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b1196b3e-aa3c-4486-a0ad-52f372819a8f, lookup_type: ById(b1196b3e-aa3c-4486-a0ad-52f372819a8f) } result = Ok(())
75752024-09-03T23:58:09.302ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75762024-09-03T23:58:09.302ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
75772024-09-03T23:58:09.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75782024-09-03T23:58:09.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
75792024-09-03T23:58:09.303ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b281022b-35b2-452e-ad2b-78e12f6ca16a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b281022b-35b2-452e-ad2b-78e12f6ca16a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1467, tv_nsec: 803750564 } })
75802024-09-03T23:58:09.303ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75812024-09-03T23:58:09.304ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df
75822024-09-03T23:58:09.305ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
75832024-09-03T23:58:09.305ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
75842024-09-03T23:58:09.305ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
75852024-09-03T23:58:09.305ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75862024-09-03T23:58:09.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
75872024-09-03T23:58:09.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
75882024-09-03T23:58:09.308ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
75892024-09-03T23:58:09.308ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
75902024-09-03T23:58:09.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
75912024-09-03T23:58:09.308ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 55.25125ms iteration = 14 status = {"errors":[],"garbage_collect_requested":[]}
75922024-09-03T23:58:09.308ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
75932024-09-03T23:58:09.308ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
75942024-09-03T23:58:09.309ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "50410430-b3bd-44a3-a269-f70139d24605", "content-length": "26", "date": "Tue, 03 Sep 2024 23:58:09 GMT"} })
75952024-09-03T23:58:09.309ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
75962024-09-03T23:58:09.309ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 56.023407ms iteration = 40 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
75972024-09-03T23:58:09.311ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
75982024-09-03T23:58:09.320ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b1196b3e-aa3c-4486-a0ad-52f372819a8f original_time_created = 2024-09-03 23:51:19.204380 UTC target_id = b1196b3e-aa3c-4486-a0ad-52f372819a8f time_created = 2024-09-03 23:51:19.204380 UTC
75992024-09-03T23:58:09.320ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 74.77588ms iteration = 40 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b1196b3e-aa3c-4486-a0ad-52f372819a8f","time_created":"2024-09-03T23:51:19.204380Z"}
76002024-09-03T23:58:09.329ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
76012024-09-03T23:58:09.329ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76022024-09-03T23:58:09.331ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
76032024-09-03T23:58:09.331ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76042024-09-03T23:58:09.333ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76052024-09-03T23:58:09.336ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: b281022b-35b2-452e-ad2b-78e12f6ca16a, lookup_type: ById(b281022b-35b2-452e-ad2b-78e12f6ca16a) } result = Ok(())
76062024-09-03T23:58:09.336ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
76072024-09-03T23:58:09.336ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76082024-09-03T23:58:09.337ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 83.910616ms iteration = 14 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
76092024-09-03T23:58:09.338ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 90.312055ms iteration = 14 status = 0
76102024-09-03T23:58:09.340ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 92.599254ms iteration = 14 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
76112024-09-03T23:58:09.341ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:56
76122024-09-03T23:58:09.341ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
76132024-09-03T23:58:09.341ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
76142024-09-03T23:58:09.341ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
76152024-09-03T23:58:09.343ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76162024-09-03T23:58:09.344ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
76172024-09-03T23:58:09.344ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
76182024-09-03T23:58:09.345ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
76192024-09-03T23:58:09.345ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76202024-09-03T23:58:09.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76212024-09-03T23:58:09.364ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
76222024-09-03T23:58:09.364ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
76232024-09-03T23:58:09.373ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 120.059686ms iteration = 14 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
76242024-09-03T23:58:09.374ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:56
76252024-09-03T23:58:09.374ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:241 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
76262024-09-03T23:58:09.374ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 121.528777ms iteration = 14 status = {"destroyed_active_vmms":0,"error":null,"failed_active_vmms":0,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
76272024-09-03T23:58:09.393ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 147.442846ms iteration = 14 status = {}
76282024-09-03T23:58:09.394ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df zone_address = fd00:1122:3344:101::2
76292024-09-03T23:58:09.394ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
76302024-09-03T23:58:09.395ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "cbf8f2fb-94d5-41ca-bbd0-67b8dc307fed", "content-length": "26", "date": "Tue, 03 Sep 2024 23:58:09 GMT"} })
76312024-09-03T23:58:09.395ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
76322024-09-03T23:58:09.396ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df
76332024-09-03T23:58:09.397ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:480 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
76342024-09-03T23:58:09.397ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 144.372329ms iteration = 14 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
76352024-09-03T23:58:09.406ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
76362024-09-03T23:58:09.406ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6545e923-7a7f-4cc0-b3bd-8350085efd77", "content-length": "2", "date": "Tue, 03 Sep 2024 23:58:09 GMT"} })
76372024-09-03T23:58:09.408ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
76382024-09-03T23:58:09.408ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
76392024-09-03T23:58:09.410ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 164.095774ms iteration = 14 status = null
76402024-09-03T23:58:09.412ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 163.931161ms iteration = 16 status = {"physical_disks_added":0}
76412024-09-03T23:58:09.449ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
76422024-09-03T23:58:09.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
76432024-09-03T23:58:09.451ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76442024-09-03T23:58:09.453ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
76452024-09-03T23:58:09.453ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
76462024-09-03T23:58:09.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
76472024-09-03T23:58:09.454ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76482024-09-03T23:58:09.456ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
76492024-09-03T23:58:09.456ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
76502024-09-03T23:58:09.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
76512024-09-03T23:58:09.465ZDEBGnexus (BackgroundTasks): client request SledAgent = b281022b-35b2-452e-ad2b-78e12f6ca16a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
76522024-09-03T23:58:09.466ZDEBGnexus (BackgroundTasks): client response SledAgent = b281022b-35b2-452e-ad2b-78e12f6ca16a background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e597a87f-39f3-4ca4-b978-c8d6c39bebbd", "content-length": "372", "date": "Tue, 03 Sep 2024 23:58:09 GMT"} })
76532024-09-03T23:58:09.466ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76542024-09-03T23:58:09.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76552024-09-03T23:58:09.469ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76562024-09-03T23:58:09.469ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76572024-09-03T23:58:09.474ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76582024-09-03T23:58:09.474ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76592024-09-03T23:58:09.479ZDEBGnexus (BackgroundTasks): client request SledAgent = b281022b-35b2-452e-ad2b-78e12f6ca16a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
76602024-09-03T23:58:09.480ZDEBGnexus (BackgroundTasks): client response SledAgent = b281022b-35b2-452e-ad2b-78e12f6ca16a background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "1dd17f0b-d312-408f-8862-78f4bdf55d31", "date": "Tue, 03 Sep 2024 23:58:09 GMT"} })
76612024-09-03T23:58:09.481ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 228.542702ms iteration = 15 status = {}
76622024-09-03T23:58:09.532ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76632024-09-03T23:58:09.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76642024-09-03T23:58:09.534ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: ec64e2ff-6fd0-4ab3-a8fa-a8a710b73297, rack_id: 1d4636f4-828e-412a-8daf-3bda355c92df, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(ccbb015a-58a4-4f0f-8a1a-5716d0b9db06) } rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df switch_location = Switch0
76652024-09-03T23:58:09.534ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76662024-09-03T23:58:09.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76672024-09-03T23:58:09.558ZDEBGnexus (BackgroundTasks): client request SledAgent = b281022b-35b2-452e-ad2b-78e12f6ca16a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
76682024-09-03T23:58:09.567ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
76692024-09-03T23:58:09.567ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "cd15a942-8958-497a-919a-0a9d24036b5d", "content-length": "121", "date": "Tue, 03 Sep 2024 23:58:09 GMT"} })
76702024-09-03T23:58:09.567ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
76712024-09-03T23:58:09.567ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = ccbb015a-58a4-4f0f-8a1a-5716d0b9db06
76722024-09-03T23:58:09.568ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
76732024-09-03T23:58:09.568ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
76742024-09-03T23:58:09.568ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df routes = {}
76752024-09-03T23:58:09.568ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df routes = {}
76762024-09-03T23:58:09.568ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df
76772024-09-03T23:58:09.568ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76782024-09-03T23:58:09.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76792024-09-03T23:58:09.570ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
76802024-09-03T23:58:09.570ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "83e58016-5811-4745-8bb8-177cf1c46a45", "content-length": "2", "date": "Tue, 03 Sep 2024 23:58:09 GMT"} })
76812024-09-03T23:58:09.570ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
76822024-09-03T23:58:09.571ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6935596b-7f61-4aec-a941-a88d7b805b96", "content-length": "52", "date": "Tue, 03 Sep 2024 23:58:09 GMT"} })
76832024-09-03T23:58:09.571ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df switch_location = Switch0
76842024-09-03T23:58:09.571ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
76852024-09-03T23:58:09.633ZDEBGnexus (BackgroundTasks): client response SledAgent = b281022b-35b2-452e-ad2b-78e12f6ca16a background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "9746d890-536c-47b0-b2f1-4651ebd10a87", "content-length": "691", "date": "Tue, 03 Sep 2024 23:58:09 GMT"} })
76862024-09-03T23:58:09.633ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
76872024-09-03T23:58:09.633ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
76882024-09-03T23:58:09.633ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
76892024-09-03T23:58:09.635ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 386.939743ms iteration = 15 status = {}
76902024-09-03T23:58:09.714ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "4e3c285b-043a-41de-a87d-3a11eefa12d1", "date": "Tue, 03 Sep 2024 23:58:09 GMT"} })
76912024-09-03T23:58:09.714ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df switch = Switch0
76922024-09-03T23:58:09.714ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
76932024-09-03T23:58:09.714ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1d4636f4-828e-412a-8daf-3bda355c92df result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "9ab9ef15-a962-42f7-89f7-adfddb444ac4", "content-length": "667", "date": "Tue, 03 Sep 2024 23:58:09 GMT"} })
76942024-09-03T23:58:09.714ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76952024-09-03T23:58:09.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76962024-09-03T23:58:09.718ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76972024-09-03T23:58:09.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76982024-09-03T23:58:09.720ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76992024-09-03T23:58:09.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77002024-09-03T23:58:09.722ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77012024-09-03T23:58:09.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77022024-09-03T23:58:09.729ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 481.871347ms iteration = 14 status = {}
77032024-09-03T23:58:09.939ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = c1a7ffd9-4063-4d3f-83a9-00209614f263 roles = RoleSet { roles: {} } uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
77042024-09-03T23:58:09.939ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = c1a7ffd9-4063-4d3f-83a9-00209614f263 resource = Database result = Ok(()) uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
77052024-09-03T23:58:09.942ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2725 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49121 req_id = c1a7ffd9-4063-4d3f-83a9-00209614f263 response_code = 200 uri = /probes/b281022b-35b2-452e-ad2b-78e12f6ca16a
77062024-09-03T23:58:09.988ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1366 local_addr = [fd00:1122:3344:101::c]:59395 method = GET remote_addr = [fd00:1122:3344:101::d]:55949 req_id = 5b90167e-2f81-4c41-9945-c61252fdb679 response_code = 200 uri = /5f5ce676-2064-4d97-b873-fbcbc29495de