Max level shown:
1 [ Aug 16 07:16:35 Enabled. ]
2 [ Aug 16 07:16:35 Rereading configuration. ]
3 [ Aug 16 07:16:36 Rereading configuration. ]
4 [ Aug 16 07:16:49 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/omicron-nexus/bin/nexus /var/svc/manifest/site/nexus/config.toml &"). ]
5 [ Aug 16 07:16:49 Method "start" exited with status 0. ]
6 note: configured to log to "/dev/stdout"
72024-08-16T07:16:49.204ZDEBGnexus: registered DTrace probes
82024-08-16T07:16:49.207ZINFOnexus: setting up nexus server file = nexus/src/lib.rs:86
92024-08-16T07:16:49.214ZINFOnexus (ServerContext): registering Oso class class = Action file = nexus/auth/src/authz/oso_generic.rs:68
102024-08-16T07:16:49.214ZINFOnexus (ServerContext): registering Oso class class = AnyActor file = nexus/auth/src/authz/oso_generic.rs:68
112024-08-16T07:16:49.214ZINFOnexus (ServerContext): registering Oso class class = AuthenticatedActor file = nexus/auth/src/authz/oso_generic.rs:68
122024-08-16T07:16:49.214ZINFOnexus (ServerContext): registering Oso class class = BlueprintConfig file = nexus/auth/src/authz/oso_generic.rs:68
132024-08-16T07:16:49.214ZINFOnexus (ServerContext): registering Oso class class = Database file = nexus/auth/src/authz/oso_generic.rs:68
142024-08-16T07:16:49.214ZINFOnexus (ServerContext): registering Oso class class = DnsConfig file = nexus/auth/src/authz/oso_generic.rs:68
152024-08-16T07:16:49.214ZINFOnexus (ServerContext): registering Oso class class = Fleet file = nexus/auth/src/authz/oso_generic.rs:68
162024-08-16T07:16:49.214ZINFOnexus (ServerContext): registering Oso class class = Inventory file = nexus/auth/src/authz/oso_generic.rs:68
172024-08-16T07:16:49.214ZINFOnexus (ServerContext): registering Oso class class = IpPoolList file = nexus/auth/src/authz/oso_generic.rs:68
182024-08-16T07:16:49.214ZINFOnexus (ServerContext): registering Oso class class = ConsoleSessionList file = nexus/auth/src/authz/oso_generic.rs:68
192024-08-16T07:16:49.214ZINFOnexus (ServerContext): registering Oso class class = DeviceAuthRequestList file = nexus/auth/src/authz/oso_generic.rs:68
202024-08-16T07:16:49.214ZINFOnexus (ServerContext): registering Oso class class = SiloCertificateList file = nexus/auth/src/authz/oso_generic.rs:68
212024-08-16T07:16:49.214ZINFOnexus (ServerContext): registering Oso class class = SiloIdentityProviderList file = nexus/auth/src/authz/oso_generic.rs:68
222024-08-16T07:16:49.214ZINFOnexus (ServerContext): registering Oso class class = SiloUserList file = nexus/auth/src/authz/oso_generic.rs:68
232024-08-16T07:16:49.214ZINFOnexus (ServerContext): registering Oso class class = Project file = nexus/auth/src/authz/oso_generic.rs:68
242024-08-16T07:16:49.214ZINFOnexus (ServerContext): registering Oso class class = Disk file = nexus/auth/src/authz/oso_generic.rs:68
252024-08-16T07:16:49.214ZINFOnexus (ServerContext): registering Oso class class = Snapshot file = nexus/auth/src/authz/oso_generic.rs:68
262024-08-16T07:16:49.214ZINFOnexus (ServerContext): registering Oso class class = ProjectImage file = nexus/auth/src/authz/oso_generic.rs:68
272024-08-16T07:16:49.214ZINFOnexus (ServerContext): registering Oso class class = Instance file = nexus/auth/src/authz/oso_generic.rs:68
282024-08-16T07:16:49.214ZINFOnexus (ServerContext): registering Oso class class = IpPool file = nexus/auth/src/authz/oso_generic.rs:68
292024-08-16T07:16:49.214ZINFOnexus (ServerContext): registering Oso class class = InstanceNetworkInterface file = nexus/auth/src/authz/oso_generic.rs:68
302024-08-16T07:16:49.214ZINFOnexus (ServerContext): registering Oso class class = Vpc file = nexus/auth/src/authz/oso_generic.rs:68
312024-08-16T07:16:49.214ZINFOnexus (ServerContext): registering Oso class class = VpcRouter file = nexus/auth/src/authz/oso_generic.rs:68
322024-08-16T07:16:49.214ZINFOnexus (ServerContext): registering Oso class class = RouterRoute file = nexus/auth/src/authz/oso_generic.rs:68
332024-08-16T07:16:49.214ZINFOnexus (ServerContext): registering Oso class class = VpcSubnet file = nexus/auth/src/authz/oso_generic.rs:68
342024-08-16T07:16:49.214ZINFOnexus (ServerContext): registering Oso class class = FloatingIp file = nexus/auth/src/authz/oso_generic.rs:68
352024-08-16T07:16:49.214ZINFOnexus (ServerContext): registering Oso class class = Image file = nexus/auth/src/authz/oso_generic.rs:68
362024-08-16T07:16:49.214ZINFOnexus (ServerContext): registering Oso class class = SiloImage file = nexus/auth/src/authz/oso_generic.rs:68
372024-08-16T07:16:49.214ZINFOnexus (ServerContext): registering Oso class class = AddressLot file = nexus/auth/src/authz/oso_generic.rs:68
382024-08-16T07:16:49.214ZINFOnexus (ServerContext): registering Oso class class = Blueprint file = nexus/auth/src/authz/oso_generic.rs:68
392024-08-16T07:16:49.214ZINFOnexus (ServerContext): registering Oso class class = LoopbackAddress file = nexus/auth/src/authz/oso_generic.rs:68
402024-08-16T07:16:49.214ZINFOnexus (ServerContext): registering Oso class class = Certificate file = nexus/auth/src/authz/oso_generic.rs:68
412024-08-16T07:16:49.214ZINFOnexus (ServerContext): registering Oso class class = ConsoleSession file = nexus/auth/src/authz/oso_generic.rs:68
422024-08-16T07:16:49.214ZINFOnexus (ServerContext): registering Oso class class = DeviceAuthRequest file = nexus/auth/src/authz/oso_generic.rs:68
432024-08-16T07:16:49.214ZINFOnexus (ServerContext): registering Oso class class = DeviceAccessToken file = nexus/auth/src/authz/oso_generic.rs:68
442024-08-16T07:16:49.214ZINFOnexus (ServerContext): registering Oso class class = PhysicalDisk file = nexus/auth/src/authz/oso_generic.rs:68
452024-08-16T07:16:49.214ZINFOnexus (ServerContext): registering Oso class class = Rack file = nexus/auth/src/authz/oso_generic.rs:68
462024-08-16T07:16:49.214ZINFOnexus (ServerContext): registering Oso class class = RoleBuiltin file = nexus/auth/src/authz/oso_generic.rs:68
472024-08-16T07:16:49.214ZINFOnexus (ServerContext): registering Oso class class = SshKey file = nexus/auth/src/authz/oso_generic.rs:68
482024-08-16T07:16:49.214ZINFOnexus (ServerContext): registering Oso class class = Silo file = nexus/auth/src/authz/oso_generic.rs:68
492024-08-16T07:16:49.214ZINFOnexus (ServerContext): registering Oso class class = SiloUser file = nexus/auth/src/authz/oso_generic.rs:68
502024-08-16T07:16:49.214ZINFOnexus (ServerContext): registering Oso class class = SiloGroup file = nexus/auth/src/authz/oso_generic.rs:68
512024-08-16T07:16:49.214ZINFOnexus (ServerContext): registering Oso class class = IdentityProvider file = nexus/auth/src/authz/oso_generic.rs:68
522024-08-16T07:16:49.214ZINFOnexus (ServerContext): registering Oso class class = SamlIdentityProvider file = nexus/auth/src/authz/oso_generic.rs:68
532024-08-16T07:16:49.214ZINFOnexus (ServerContext): registering Oso class class = Sled file = nexus/auth/src/authz/oso_generic.rs:68
542024-08-16T07:16:49.214ZINFOnexus (ServerContext): registering Oso class class = TufRepo file = nexus/auth/src/authz/oso_generic.rs:68
552024-08-16T07:16:49.214ZINFOnexus (ServerContext): registering Oso class class = TufArtifact file = nexus/auth/src/authz/oso_generic.rs:68
562024-08-16T07:16:49.214ZINFOnexus (ServerContext): registering Oso class class = Zpool file = nexus/auth/src/authz/oso_generic.rs:68
572024-08-16T07:16:49.214ZINFOnexus (ServerContext): registering Oso class class = Service file = nexus/auth/src/authz/oso_generic.rs:68
582024-08-16T07:16:49.214ZINFOnexus (ServerContext): registering Oso class class = UserBuiltin file = nexus/auth/src/authz/oso_generic.rs:68
592024-08-16T07:16:49.214ZINFOnexus (ServerContext): full Oso configuration config = #\n# Oso configuration for Omicron\n# This file is augmented by generated snippets.\n#\n\n#\n# ACTOR TYPES AND BASIC RULES\n#\n\n# `AnyActor` includes both authenticated and unauthenticated users.\nactor AnyActor {}\n\n# An `AuthenticatedActor` has an identity in the system. All of our operations\n# today require that an actor be authenticated.\nactor AuthenticatedActor {}\n\n# For any resource, `actor` can perform action `action` on it if they're\n# authenticated and their role(s) give them the corresponding permission on that\n# resource.\nallow(actor: AnyActor, action: Action, resource) if\n actor.authenticated and\n has_permission(actor.authn_actor.unwrap(), action.to_perm(), resource);\n\n# Define role relationships\nhas_role(actor: AuthenticatedActor, role: String, resource: Resource)\n\tif resource.has_role(actor, role);\n\n#\n# ROLES AND PERMISSIONS IN THE FLEET/SILO/PROJECT HIERARCHY\n#\n# We define the following permissions for most resources in the system:\n#\n# - "create_child": required to create child resources (of any type)\n#\n# - "list_children": required to list child resources (of all types) of a\n# resource\n#\n# - "modify": required to modify or delete a resource\n#\n# - "read": required to read a resource\n#\n# We define the following predefined roles for only a few high-level resources:\n# the Fleet (see below), Silo, Organization, and Project. The specific roles\n# are oriented around intended use-cases:\n#\n# - "admin": has all permissions on the resource\n#\n# - "collaborator": has "read", "list_children", and "create_child", plus\n# the "admin" role for child resources. The idea is that if you're an\n# Organization Collaborator, you have full control over the Projects within\n# the Organization, but you cannot modify or delete the Organization itself.\n#\n# - "viewer": has "read" and "list_children" on a resource\n#\n# Below the Project level, permissions are granted via roles at the Project\n# level. For example, for someone to be able to create, modify, or delete any\n# Instances, they must be granted project.collaborator, which means they can\n# create, modify, or delete _all_ resources in the Project.\n#\n# The complete set of predefined roles:\n#\n# - fleet.admin (superuser for the whole system)\n# - fleet.collaborator (can manage Silos)\n# - fleet.viewer (can read most non-siloed resources in the system)\n# - silo.admin (superuser for the silo)\n# - silo.collaborator (can create and own Organizations)\n# - silo.viewer (can read most resources within the Silo)\n# - organization.admin (complete control over an organization)\n# - organization.collaborator (can manage Projects)\n# - organization.viewer (can read most resources within the Organization)\n# - project.admin (complete control over a Project)\n# - project.collaborator (can manage all resources within the Project)\n# - project.viewer (can read most resources within the Project)\n#\n# Outside the Silo/Organization/Project hierarchy, we (currently) treat most\n# resources as nested under Fleet or else a synthetic resource (see below). We\n# do not yet support role assignments on anything other than Fleet, Silo,\n# Organization, or Project.\n#\n\n# "Fleet" is a global singleton representing the whole system. The name comes\n# from the idea described in RFD 24, but it's not quite right. This probably\n# should be more like "Region" or "AvailabilityZone". The precise boundaries\n# have not yet been figured out.\nresource Fleet {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\troles = [\n\t # Roles that can be attached by users\n\t "admin",\n\t "collaborator",\n\t "viewer",\n\n\t # Internal-only roles\n\t "external-authenticator"\n\t];\n\n\t# Roles implied by other roles on this resource\n\t"viewer" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\t"create_child" if "collaborator";\n\t"modify" if "admin";\n}\n\n# For fleets specifically, roles can be conferred by roles on the user's Silo.\nhas_role(actor: AuthenticatedActor, role: String, _: Fleet) if\n\tsilo_role in actor.confers_fleet_role(role) and\n\thas_role(actor, silo_role, actor.silo.unwrap());\n\nresource Silo {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\troles = [ "admin", "collaborator", "viewer" ];\n\n\t# Roles implied by other roles on this resource\n\t"viewer" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\n\t"create_child" if "collaborator";\n\t"modify" if "admin";\n\n\t# Permissions implied by roles on this resource's parent (Fleet). Fleet\n\t# privileges allow a user to see and potentially administer the Silo,\n\t# but they do not give anyone permission to look at anything inside the\n\t# Silo. To achieve this, we use permission rules here. (If we granted\n\t# Fleet administrators _roles_ on the Silo, then those would cascade\n\t# into the Silo as well.)\n\trelations = { parent_fleet: Fleet };\n\t"read" if "viewer" on "parent_fleet";\n\t"modify" if "collaborator" on "parent_fleet";\n\n\t# external authenticator has to create silo users\n\t"list_children" if "external-authenticator" on "parent_fleet";\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\n\nhas_relation(fleet: Fleet, "parent_fleet", silo: Silo)\n\tif silo.fleet = fleet;\n\n# As a special case, all authenticated users can read their own Silo. That's\n# not quite the same as having the "viewer" role. For example, they cannot list\n# Organizations in the Silo.\n#\n# One reason this is necessary is because if an unprivileged user tries to\n# create an Organization using "POST /organizations", they should get back a 403\n# (which implies they're able to see /organizations, which is essentially seeing\n# the Silo itself) rather than a 404. This behavior isn't a hard constraint\n# (i.e., you could reasonably get a 404 for an API you're not allowed to call).\n# Nor is the implementation (i.e., we could special-case this endpoint somehow).\n# But granting this permission is the simplest way to keep this endpoint's\n# behavior consistent with the rest of the API.\n#\n# This rule is also used to determine if a user can list the identity providers\n# in the Silo (which they should be able to), since that's predicated on being\n# able to read the Silo.\n#\n# It's unclear what else would break if users couldn't see their own Silo.\nhas_permission(actor: AuthenticatedActor, "read", silo: Silo)\n\tif silo in actor.silo;\n\nresource Project {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\troles = [ "admin", "collaborator", "viewer" ];\n\n\t# Roles implied by other roles on this resource\n\t"viewer" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\t"create_child" if "collaborator";\n\t"modify" if "admin";\n\n\t# Roles implied by roles on this resource's parent (Silo)\n\trelations = { parent_silo: Silo };\n\t"admin" if "collaborator" on "parent_silo";\n\t"viewer" if "viewer" on "parent_silo";\n}\nhas_relation(silo: Silo, "parent_silo", project: Project)\n\tif project.silo = silo;\n\n#\n# GENERAL RESOURCES OUTSIDE THE SILO/PROJECT HIERARCHY\n#\n# Many resources use snippets of Polar generated by the `authz_resource!` Rust\n# macro. Some resources require custom Polar code. Those appear here.\n#\n\nresource Certificate {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Fleet-level and silo-level roles both grant privileges on certificates.\n\t"read" if "admin" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"read" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", certificate: Certificate)\n\tif certificate.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", certificate: Certificate)\n\tif certificate.silo.fleet = fleet;\n\nresource SiloUser {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\t# Fleet and Silo administrators can manage a Silo's users. This is one\n\t# of the only areas of Silo configuration that Fleet Administrators have\n\t# permissions on.\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\t"list_children" if "read" on "parent_silo";\n\t"read" if "read" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\t"list_children" if "read" on "parent_fleet";\n\t"read" if "read" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", user: SiloUser)\n\tif user.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", user: SiloUser)\n\tif user.silo.fleet = fleet;\n\n# authenticated actors have all permissions on themselves\nhas_permission(actor: AuthenticatedActor, _perm: String, silo_user: SiloUser)\n if actor.equals_silo_user(silo_user);\n\nhas_permission(actor: AuthenticatedActor, "read", silo_user: SiloUser)\n if silo_user.silo in actor.silo;\n\nresource SiloGroup {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\trelations = { parent_silo: Silo };\n\t"list_children" if "read" on "parent_silo";\n\t"read" if "read" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n}\nhas_relation(silo: Silo, "parent_silo", group: SiloGroup)\n\tif group.silo = silo;\n\nresource SshKey {\n\tpermissions = [ "read", "modify" ];\n\trelations = { silo_user: SiloUser };\n\n\t"read" if "read" on "silo_user";\n\t"modify" if "modify" on "silo_user";\n}\nhas_relation(user: SiloUser, "silo_user", ssh_key: SshKey)\n\tif ssh_key.silo_user = user;\n\nresource IdentityProvider {\n\tpermissions = [\n\t "read",\n\t "modify",\n\t "create_child",\n\t "list_children",\n\t];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Silo-level roles grant privileges on identity providers.\n\t"read" if "viewer" on "parent_silo";\n\t"list_children" if "viewer" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\n\t# Fleet-level roles also grant privileges on identity providers.\n\t"read" if "viewer" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", identity_provider: IdentityProvider)\n\tif identity_provider.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: IdentityProvider)\n\tif collection.silo.fleet = fleet;\n\nresource SamlIdentityProvider {\n\tpermissions = [\n\t "read",\n\t "modify",\n\t "create_child",\n\t "list_children",\n\t];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Silo-level roles grant privileges on identity providers.\n\t"read" if "viewer" on "parent_silo";\n\t"list_children" if "viewer" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\n\t# Fleet-level roles also grant privileges on identity providers.\n\t"read" if "viewer" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", saml_identity_provider: SamlIdentityProvider)\n\tif saml_identity_provider.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SamlIdentityProvider)\n\tif collection.silo.fleet = fleet;\n\n#\n# SYNTHETIC RESOURCES OUTSIDE THE SILO HIERARCHY\n#\n# The resources here do not correspond to anything that appears explicitly in\n# the API or is stored in the database. These are used either at the top level\n# of the API path (e.g., "/v1/system/ip-pools") or as an implementation detail of the system\n# (in the case of console sessions and "Database"). The policies are\n# either statically-defined in this file or driven by role assignments on the\n# Fleet. None of these resources defines their own roles.\n#\n\n# Describes the policy for reading and modifying DNS configuration\n# (both internal and external)\nresource DnsConfig {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_fleet: Fleet };\n\t# "external-authenticator" requires these permissions because that's the\n\t# context that Nexus uses when creating and deleting Silos. These\n\t# operations necessarily need to read and modify DNS configuration.\n\t"read" if "external-authenticator" on "parent_fleet";\n\t"modify" if "external-authenticator" on "parent_fleet";\n\t# "admin" on the parent fleet also gets these permissions, primarily for\n\t# the test suite.\n\t"read" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", dns_config: DnsConfig)\n\tif dns_config.fleet = fleet;\n\n# Describes the policy for accessing blueprints\nresource BlueprintConfig {\n\tpermissions = [\n\t "list_children", # list blueprints\n\t "create_child", # create blueprint\n\t "read", # read the current target\n\t "modify", # change the current target\n\t];\n\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"read" if "viewer" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", list: BlueprintConfig)\n\tif list.fleet = fleet;\n\n# Describes the policy for reading and modifying low-level inventory\nresource Inventory {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_fleet: Fleet };\n\t"read" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", inventory: Inventory)\n\tif inventory.fleet = fleet;\n\n# Describes the policy for accessing "/v1/system/ip-pools" in the API\nresource IpPoolList {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "create_child",\n\t];\n\n\t# Fleet Administrators can create or modify the IP Pools list.\n\trelations = { parent_fleet: Fleet };\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n\n\t# Fleet Viewers can list IP Pools\n\t"list_children" if "viewer" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", ip_pool_list: IpPoolList)\n\tif ip_pool_list.fleet = fleet;\n\n# Any authenticated user can create a child of a provided IP Pool.\n# This is necessary to use the pools when provisioning instances.\nhas_permission(actor: AuthenticatedActor, "create_child", ip_pool: IpPool)\n\tif silo in actor.silo and silo.fleet = ip_pool.fleet;\n\n# Describes the policy for creating and managing web console sessions.\nresource ConsoleSessionList {\n\tpermissions = [ "create_child" ];\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", collection: ConsoleSessionList)\n\tif collection.fleet = fleet;\n\n# Describes the policy for creating and managing device authorization requests.\nresource DeviceAuthRequestList {\n\tpermissions = [ "create_child" ];\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", collection: DeviceAuthRequestList)\n\tif collection.fleet = fleet;\n\n# Describes the policy for creating and managing Silo certificates\nresource SiloCertificateList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Both Fleet and Silo administrators can see and modify the Silo's\n\t# certificates.\n\t"list_children" if "admin" on "parent_silo";\n\t"list_children" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloCertificateList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloCertificateList)\n\tif collection.silo.fleet = fleet;\n\n# Describes the policy for creating and managing Silo identity providers\nresource SiloIdentityProviderList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Everyone who can read the Silo (which includes all the users in the\n\t# Silo) can see the identity providers in it.\n\t"list_children" if "read" on "parent_silo";\n\n\t# Fleet and Silo administrators can manage the Silo's identity provider\n\t# configuration. This is one of the only areas of Silo configuration\n\t# that Fleet Administrators have permissions on. This is also one of\n\t# the only cases where we need to look two levels up the hierarchy to\n\t# see if somebody has the right permission. For most other things,\n\t# permissions cascade down the hierarchy so we only need to look at the\n\t# parent.\n\t"create_child" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloIdentityProviderList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloIdentityProviderList)\n\tif collection.silo.fleet = fleet;\n\n# Describes the policy for creating and managing Silo users (mostly intended for\n# API-managed users)\nresource SiloUserList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Everyone who can read the Silo (which includes all the users in the\n\t# Silo) can see the users in it.\n\t"list_children" if "read" on "parent_silo";\n\n\t# Fleet and Silo administrators can manage the Silo's users. This is\n\t# one of the only areas of Silo configuration that Fleet Administrators\n\t# have permissions on. This is also one of the few cases (so far) where\n\t# we need to look two levels up the hierarchy to see if somebody has the\n\t# right permission. For most other things, permissions cascade down the\n\t# hierarchy so we only need to look at the parent.\n\t"create_child" if "admin" on "parent_silo";\n\t"list_children" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloUserList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloUserList)\n\tif collection.silo.fleet = fleet;\n\n# These rules grants the external authenticator role the permissions it needs to\n# read silo users and modify their sessions. This is necessary for login to\n# work.\nhas_permission(actor: AuthenticatedActor, "read", silo: Silo)\n\tif has_role(actor, "external-authenticator", silo.fleet);\nhas_permission(actor: AuthenticatedActor, "read", user: SiloUser)\n\tif has_role(actor, "external-authenticator", user.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", user: SiloUser)\n\tif has_role(actor, "external-authenticator", user.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "read", group: SiloGroup)\n\tif has_role(actor, "external-authenticator", group.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", group: SiloGroup)\n\tif has_role(actor, "external-authenticator", group.silo.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", session: ConsoleSession)\n\tif has_role(actor, "external-authenticator", session.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", session: ConsoleSession)\n\tif has_role(actor, "external-authenticator", session.fleet);\n\n# All authenticated users can read and delete device authn requests because\n# by necessity these operations happen before we've figured out what user (or\n# even Silo) the device auth is associated with. Any user can claim a device\n# auth request with the right user code (that's how it works) -- it's the user\n# code and associated logic that prevents unauthorized access here.\nhas_permission(_actor: AuthenticatedActor, "read", _device_auth: DeviceAuthRequest);\nhas_permission(_actor: AuthenticatedActor, "modify", _device_auth: DeviceAuthRequest);\n\nhas_permission(actor: AuthenticatedActor, "read", device_token: DeviceAccessToken)\n\tif has_role(actor, "external-authenticator", device_token.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", identity_provider: IdentityProvider)\n\tif has_role(actor, "external-authenticator", identity_provider.silo.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", saml_identity_provider: SamlIdentityProvider)\n\tif has_role(actor, "external-authenticator", saml_identity_provider.silo.fleet);\n\n# Describes the policy for who can access the internal database.\nresource Database {\n\tpermissions = [\n\t # "query" is required to perform any query against the database,\n\t # whether a read or write query. This is checked when an operation\n\t # checks out a database connection from the connection pool.\n\t #\n\t # Any authenticated user gets this permission. There's generally\n\t # some other authz check involved in the database query. For\n\t # example, if you're querying the database to "read" a "Project", we\n\t # should also be checking that. So why do we do this at all? It's\n\t # a belt-and-suspenders measure so that if we somehow introduced an\n\t # unauthenticated code path that hits the database, it cannot be\n\t # used to DoS the database because we won't allow the operation to\n\t # make the query. (As long as the code path _is_ authenticated, we\n\t # can use throttling mechanisms to prevent DoS.)\n\t "query",\n\n\t # "modify" is required to populate database data that's delivered\n\t # with the system. It should also be required for schema changes,\n\t # when we support those. This is separate from "query" so that we\n\t # cannot accidentally invoke these code paths from API calls and\n\t # other general functions.\n\t "modify"\n\t];\n}\n\n# All authenticated users have the "query" permission on the database.\nhas_permission(_actor: AuthenticatedActor, "query", _resource: Database);\n\n# The "db-init" user is the only one with the "modify" permission.\nhas_permission(USER_DB_INIT: AuthenticatedActor, "modify", _resource: Database);\nhas_permission(USER_DB_INIT: AuthenticatedActor, "create_child", _resource: IpPoolList);\n# It also has "admin" on the internal silo to populate it with built-in resources.\n# TODO-completeness: actually limit to just internal silo and not all silos\nhas_role(USER_DB_INIT: AuthenticatedActor, "admin", _silo: Silo);\n\n# Allow the internal API admin permissions on all silos.\nhas_role(USER_INTERNAL_API: AuthenticatedActor, "admin", _silo: Silo);\n\n\n\n resource Disk {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Disk)\n if child.project = parent;\n \n\n resource Snapshot {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Snapshot)\n if child.project = parent;\n \n\n resource ProjectImage {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: ProjectImage)\n if child.project = parent;\n \n\n resource Instance {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Instance)\n if child.project = parent;\n \n\n resource IpPool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: IpPool)\n if child.fleet = fleet;\n \n\n resource InstanceNetworkInterface {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Instance\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InstanceNetworkInterface)\n if has_relation(project, "containing_project", child.instance);\n\n has_relation(parent: Instance, "parent", child: InstanceNetworkInterface)\n if child.instance = parent;\n \n\n resource Vpc {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Vpc)\n if child.project = parent;\n \n\n resource VpcRouter {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Vpc\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: VpcRouter)\n if has_relation(project, "containing_project", child.vpc);\n\n has_relation(parent: Vpc, "parent", child: VpcRouter)\n if child.vpc = parent;\n \n\n resource RouterRoute {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: VpcRouter\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: RouterRoute)\n if has_relation(project, "containing_project", child.vpc_router);\n\n has_relation(parent: VpcRouter, "parent", child: RouterRoute)\n if child.vpc_router = parent;\n \n\n resource VpcSubnet {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Vpc\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: VpcSubnet)\n if has_relation(project, "containing_project", child.vpc);\n\n has_relation(parent: Vpc, "parent", child: VpcSubnet)\n if child.vpc = parent;\n \n\n resource FloatingIp {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: FloatingIp)\n if child.project = parent;\n \n\n resource Image {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_silo: Silo };\n "list_children" if "viewer" on "containing_silo";\n "read" if "viewer" on "containing_silo";\n "modify" if "collaborator" on "containing_silo";\n "create_child" if "collaborator" on "containing_silo";\n }\n\n has_relation(parent: Silo, "containing_silo", child: Image)\n if child.silo = parent;\n \n\n resource SiloImage {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_silo: Silo };\n "list_children" if "viewer" on "containing_silo";\n "read" if "viewer" on "containing_silo";\n "modify" if "collaborator" on "containing_silo";\n "create_child" if "collaborator" on "containing_silo";\n }\n\n has_relation(parent: Silo, "containing_silo", child: SiloImage)\n if child.silo = parent;\n \n\n resource AddressLot {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: AddressLot)\n if child.fleet = fleet;\n \n\n resource Blueprint {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Blueprint)\n if child.fleet = fleet;\n \n\n resource LoopbackAddress {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: LoopbackAddress)\n if child.fleet = fleet;\n \n\n\n resource ConsoleSession {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: ConsoleSession)\n if child.fleet = fleet;\n \n\n resource DeviceAuthRequest {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: DeviceAuthRequest)\n if child.fleet = fleet;\n \n\n resource DeviceAccessToken {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: DeviceAccessToken)\n if child.fleet = fleet;\n \n\n resource PhysicalDisk {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: PhysicalDisk)\n if child.fleet = fleet;\n \n\n resource Rack {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Rack)\n if child.fleet = fleet;\n \n\n resource RoleBuiltin {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: RoleBuiltin)\n if child.fleet = fleet;\n \n\n\n\n\n\n\n\n resource Sled {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Sled)\n if child.fleet = fleet;\n \n\n resource TufRepo {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: TufRepo)\n if child.fleet = fleet;\n \n\n resource TufArtifact {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: TufArtifact)\n if child.fleet = fleet;\n \n\n resource Zpool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Zpool)\n if child.fleet = fleet;\n \n\n resource Service {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Service)\n if child.fleet = fleet;\n \n\n resource UserBuiltin {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: UserBuiltin)\n if child.fleet = fleet;\n file = nexus/auth/src/authz/oso_generic.rs:89
602024-08-16T07:16:49.232ZINFOnexus (ServerContext): Setting up resolver using DNS servers for subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344::, width: 48 } } file = nexus/src/context.rs:217
612024-08-16T07:16:49.235ZINFOnexus (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = internal-dns/src/resolver.rs:73
622024-08-16T07:16:49.240ZINFOnexus (ServerContext): Accessing DB url from DNS file = nexus/src/context.rs:246
632024-08-16T07:16:49.266ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _cockroach._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_cockroach._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 32221, target: Name("09fcc4c3-1a1f-42bb-87f6-6db77b0720a0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 32221, target: Name("19b9c556-e904-4b05-b8c9-0d4746115121.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 32221, target: Name("3e8baf1b-b50c-4219-84d8-b24c3d6dd215.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 32221, target: Name("92bc90c7-307e-4496-b47b-c75e1073f89d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 32221, target: Name("ce2c8029-d512-4384-b2d0-0e4e7b91a8e6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ce2c8029-d512-4384-b2d0-0e4e7b91a8e6.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::3))) }], valid_until: Instant { tv_sec: 1072, tv_nsec: 641932461 } })
642024-08-16T07:16:49.268ZINFOnexus (ServerContext): DB addresses: [fd00:1122:3344:101::6]:32221,[fd00:1122:3344:101::7]:32221,[fd00:1122:3344:101::5]:32221,[fd00:1122:3344:101::4]:32221,[fd00:1122:3344:101::3]:32221 file = nexus/src/context.rs:276
652024-08-16T07:16:49.271ZINFOnexus (db::Pool): database connection pool database_url = postgresql://root@[fd00:1122:3344:101::6]:32221,[fd00:1122:3344:101::7]:32221,[fd00:1122:3344:101::5]:32221,[fd00:1122:3344:101::4]:32221,[fd00:1122:3344:101::3]:32221/omicron?sslmode=disable file = nexus/db-queries/src/db/pool.rs:69
662024-08-16T07:16:49.456ZINFOnexus: Database schema version is up to date desired_version = 87.0.0 file = nexus/db-queries/src/db/datastore/db_metadata.rs:145 found_version = 87.0.0
672024-08-16T07:16:49.459ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1072, tv_nsec: 834732913 } })
682024-08-16T07:16:49.459ZINFOnexus (SEC): SEC running file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:813 sec_id = 0d900881-9285-4dbf-910f-5e4676c8f133
692024-08-16T07:16:49.460ZINFOnexus (Nexus): Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1050
702024-08-16T07:16:49.508ZINFOnexus (Nexus): determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
712024-08-16T07:16:49.508ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
722024-08-16T07:16:49.514ZDEBGnexus (MgsClient): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "815bfe1e-f9f7-4122-8135-5a42290f1a6e", "content-length": "26", "date": "Fri, 16 Aug 2024 07:16:49 GMT"} })
732024-08-16T07:16:49.514ZINFOnexus (Nexus): identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
742024-08-16T07:16:49.514ZINFOnexus (Nexus): completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
752024-08-16T07:16:49.546ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1072, tv_nsec: 921315723 } })
762024-08-16T07:16:49.546ZINFOnexus (Nexus): Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1050
772024-08-16T07:16:49.578ZINFOnexus (Nexus): determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
782024-08-16T07:16:49.578ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
792024-08-16T07:16:49.578ZDEBGnexus (MgsClient): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e24c25e9-0383-4ae7-a5fa-0fd7220d95df", "content-length": "26", "date": "Fri, 16 Aug 2024 07:16:49 GMT"} })
802024-08-16T07:16:49.579ZINFOnexus (Nexus): identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
812024-08-16T07:16:49.579ZINFOnexus (Nexus): completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
822024-08-16T07:16:49.652ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
832024-08-16T07:16:49.660ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
842024-08-16T07:16:49.662ZDEBGnexus (DataLoader): attempting to create built-in users
852024-08-16T07:16:49.662ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
862024-08-16T07:16:49.662ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
872024-08-16T07:16:49.696ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /artifacts/{kind}/{name}/{version}
882024-08-16T07:16:49.696ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /bgtasks
892024-08-16T07:16:49.696ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /bgtasks/activate
902024-08-16T07:16:49.696ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /bgtasks/view/{bgtask_name}
912024-08-16T07:16:49.696ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/downstairs/{downstairs_id}/stop-request
922024-08-16T07:16:49.696ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/downstairs/{downstairs_id}/stopped
932024-08-16T07:16:49.696ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/repair/{repair_id}/progress
942024-08-16T07:16:49.696ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/repair-finish
952024-08-16T07:16:49.696ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/repair-start
962024-08-16T07:16:49.696ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /demo-saga
972024-08-16T07:16:49.696ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /demo-saga/{demo_saga_id}/complete
982024-08-16T07:16:49.696ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /deployment/blueprints/all
992024-08-16T07:16:49.696ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = DELETE path = /deployment/blueprints/all/{blueprint_id}
1002024-08-16T07:16:49.696ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /deployment/blueprints/all/{blueprint_id}
1012024-08-16T07:16:49.696ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /deployment/blueprints/import
1022024-08-16T07:16:49.696ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /deployment/blueprints/regenerate
1032024-08-16T07:16:49.696ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /deployment/blueprints/target
1042024-08-16T07:16:49.696ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /deployment/blueprints/target
1052024-08-16T07:16:49.696ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = PUT path = /deployment/blueprints/target/enabled
1062024-08-16T07:16:49.696ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /disk/{disk_id}/remove-read-only-parent
1072024-08-16T07:16:49.696ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = PUT path = /disks/{disk_id}
1082024-08-16T07:16:49.696ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = PUT path = /instances/{instance_id}
1092024-08-16T07:16:49.697ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /instances/{instance_id}/migrate
1102024-08-16T07:16:49.697ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /metrics/collectors
1112024-08-16T07:16:49.697ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /metrics/collectors/{collector_id}/producers
1122024-08-16T07:16:49.697ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /metrics/producers
1132024-08-16T07:16:49.697ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /nat/ipv4/changeset/{from_gen}
1142024-08-16T07:16:49.697ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /physical-disk/expunge
1152024-08-16T07:16:49.697ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /probes/{sled}
1162024-08-16T07:16:49.697ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = PUT path = /racks/{rack_id}/initialization-complete
1172024-08-16T07:16:49.697ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /sagas
1182024-08-16T07:16:49.697ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /sagas/{saga_id}
1192024-08-16T07:16:49.697ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /sled-agents/{sled_id}
1202024-08-16T07:16:49.697ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /sled-agents/{sled_id}
1212024-08-16T07:16:49.697ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /sled-agents/{sled_id}/firewall-rules-update
1222024-08-16T07:16:49.697ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /sleds/add
1232024-08-16T07:16:49.697ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /sleds/expunge
1242024-08-16T07:16:49.697ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /sleds/uninitialized
1252024-08-16T07:16:49.697ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = PUT path = /switch/{switch_id}
1262024-08-16T07:16:49.697ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /volume/{volume_id}/remove-read-only-parent
1272024-08-16T07:16:49.697ZINFOnexus (dropshot_internal): listening file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:205 local_addr = [fd00:1122:3344:101::c]:12221
1282024-08-16T07:16:49.697ZDEBGnexus (dropshot_internal): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::c]:12221
1292024-08-16T07:16:49.697ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
1302024-08-16T07:16:49.697ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
1312024-08-16T07:16:49.704ZWARNnexus: Cannot look up rack: Object (of type ById(e1b0d583-7b20-4a4b-97f9-9f83300aeb7a)) not found: rack file = nexus/src/app/rack.rs:732
1322024-08-16T07:16:49.758ZINFOnexus (DataLoader): created 5 built-in users file = nexus/db-queries/src/db/datastore/silo_user.rs:394
1332024-08-16T07:16:49.758ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1342024-08-16T07:16:49.759ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1352024-08-16T07:16:49.759ZDEBGnexus (DataLoader): attempting to create built-in roles
1362024-08-16T07:16:49.759ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1372024-08-16T07:16:49.759ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1382024-08-16T07:16:49.791ZINFOnexus (DataLoader): created 10 built-in roles file = nexus/db-queries/src/db/datastore/role.rs:85
1392024-08-16T07:16:49.791ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1402024-08-16T07:16:49.792ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1412024-08-16T07:16:49.792ZDEBGnexus (DataLoader): attempting to create built-in role assignments
1422024-08-16T07:16:49.792ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1432024-08-16T07:16:49.792ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1442024-08-16T07:16:49.937ZINFOnexus (DataLoader): created 4 built-in role assignments file = nexus/db-queries/src/db/datastore/role.rs:114
1452024-08-16T07:16:49.937ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1462024-08-16T07:16:49.938ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1472024-08-16T07:16:49.938ZDEBGnexus (DataLoader): attempting to create built-in silos
1482024-08-16T07:16:49.938ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1492024-08-16T07:16:49.938ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1502024-08-16T07:16:50.040ZINFOnexus (DataLoader): created 2 built-in silos file = nexus/db-queries/src/db/datastore/silo.rs:95
1512024-08-16T07:16:50.040ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1522024-08-16T07:16:50.041ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1532024-08-16T07:16:50.057ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1542024-08-16T07:16:50.058ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1552024-08-16T07:16:50.058ZDEBGnexus (DataLoader): attempting to create built-in projects
1562024-08-16T07:16:50.058ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1572024-08-16T07:16:50.058ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1582024-08-16T07:16:50.070ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1592024-08-16T07:16:50.071ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1602024-08-16T07:16:50.100ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1612024-08-16T07:16:50.100ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1622024-08-16T07:16:50.129ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1632024-08-16T07:16:50.132ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) } result = Ok(())
1642024-08-16T07:16:50.132ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1652024-08-16T07:16:50.132ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1662024-08-16T07:16:50.133ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1672024-08-16T07:16:50.133ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1682024-08-16T07:16:50.134ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1692024-08-16T07:16:50.135ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) } result = Ok(())
1702024-08-16T07:16:50.135ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1712024-08-16T07:16:50.135ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1722024-08-16T07:16:50.167ZINFOnexus (DataLoader): created built-in services project file = nexus/db-queries/src/db/datastore/project.rs:122
1732024-08-16T07:16:50.167ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1742024-08-16T07:16:50.168ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1752024-08-16T07:16:50.168ZDEBGnexus (DataLoader): attempting to create built-in VPCs
1762024-08-16T07:16:50.168ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1772024-08-16T07:16:50.168ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1782024-08-16T07:16:50.176ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1792024-08-16T07:16:50.176ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1802024-08-16T07:16:50.177ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1812024-08-16T07:16:50.177ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1822024-08-16T07:16:50.178ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1832024-08-16T07:16:50.178ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1842024-08-16T07:16:50.179ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1852024-08-16T07:16:50.179ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1862024-08-16T07:16:50.180ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1872024-08-16T07:16:50.182ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) } result = Ok(())
1882024-08-16T07:16:50.182ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1892024-08-16T07:16:50.183ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1902024-08-16T07:16:50.183ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1912024-08-16T07:16:50.184ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1922024-08-16T07:16:50.184ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1932024-08-16T07:16:50.185ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1942024-08-16T07:16:50.185ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1952024-08-16T07:16:50.187ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) } result = Ok(())
1962024-08-16T07:16:50.187ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1972024-08-16T07:16:50.187ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1982024-08-16T07:16:50.202ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1992024-08-16T07:16:50.203ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2002024-08-16T07:16:50.210ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2012024-08-16T07:16:50.210ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2022024-08-16T07:16:50.211ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2032024-08-16T07:16:50.212ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2042024-08-16T07:16:50.212ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2052024-08-16T07:16:50.213ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2062024-08-16T07:16:50.213ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2072024-08-16T07:16:50.216ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") } result = Ok(())
2082024-08-16T07:16:50.216ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2092024-08-16T07:16:50.216ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2102024-08-16T07:16:50.261ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2112024-08-16T07:16:50.261ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2122024-08-16T07:16:50.262ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2132024-08-16T07:16:50.262ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2142024-08-16T07:16:50.263ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2152024-08-16T07:16:50.263ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2162024-08-16T07:16:50.264ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2172024-08-16T07:16:50.267ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
2182024-08-16T07:16:50.267ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2192024-08-16T07:16:50.268ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2202024-08-16T07:16:50.320ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2212024-08-16T07:16:50.320ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2222024-08-16T07:16:50.321ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2232024-08-16T07:16:50.321ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2242024-08-16T07:16:50.322ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2252024-08-16T07:16:50.322ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2262024-08-16T07:16:50.323ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2272024-08-16T07:16:50.326ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
2282024-08-16T07:16:50.326ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2292024-08-16T07:16:50.326ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2302024-08-16T07:16:50.363ZDEBGnexus (DataLoader): attempting to create built-in VPC firewall rules
2312024-08-16T07:16:50.363ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2322024-08-16T07:16:50.363ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2332024-08-16T07:16:50.366ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2342024-08-16T07:16:50.366ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2352024-08-16T07:16:50.367ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2362024-08-16T07:16:50.367ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2372024-08-16T07:16:50.368ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2382024-08-16T07:16:50.368ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2392024-08-16T07:16:50.369ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2402024-08-16T07:16:50.369ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2412024-08-16T07:16:50.370ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2422024-08-16T07:16:50.370ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2432024-08-16T07:16:50.371ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2442024-08-16T07:16:50.373ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
2452024-08-16T07:16:50.374ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2462024-08-16T07:16:50.374ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2472024-08-16T07:16:50.375ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2482024-08-16T07:16:50.375ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2492024-08-16T07:16:50.375ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2502024-08-16T07:16:50.376ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2512024-08-16T07:16:50.377ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2522024-08-16T07:16:50.380ZDEBGnexus (DataLoader): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
2532024-08-16T07:16:50.380ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2542024-08-16T07:16:50.380ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2552024-08-16T07:16:50.403ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2562024-08-16T07:16:50.404ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2572024-08-16T07:16:50.404ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2582024-08-16T07:16:50.405ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2592024-08-16T07:16:50.405ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2602024-08-16T07:16:50.406ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2612024-08-16T07:16:50.407ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2622024-08-16T07:16:50.409ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
2632024-08-16T07:16:50.411ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2642024-08-16T07:16:50.412ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2652024-08-16T07:16:50.472ZINFOnexus (DataLoader): created built-in VPC firewall rules file = nexus/db-queries/src/db/datastore/vpc.rs:252
2662024-08-16T07:16:50.472ZDEBGnexus (DataLoader): attempting to create built-in VPC Subnets
2672024-08-16T07:16:50.472ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2682024-08-16T07:16:50.473ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2692024-08-16T07:16:50.482ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2702024-08-16T07:16:50.482ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2712024-08-16T07:16:50.483ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2722024-08-16T07:16:50.484ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2732024-08-16T07:16:50.485ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2742024-08-16T07:16:50.485ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2752024-08-16T07:16:50.486ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2762024-08-16T07:16:50.486ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2772024-08-16T07:16:50.487ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2782024-08-16T07:16:50.487ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2792024-08-16T07:16:50.488ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2802024-08-16T07:16:50.490ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
2812024-08-16T07:16:50.490ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2822024-08-16T07:16:50.490ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2832024-08-16T07:16:50.505ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2842024-08-16T07:16:50.505ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2852024-08-16T07:16:50.506ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2862024-08-16T07:16:50.506ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2872024-08-16T07:16:50.507ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2882024-08-16T07:16:50.507ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2892024-08-16T07:16:50.508ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2902024-08-16T07:16:50.511ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
2912024-08-16T07:16:50.546ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2922024-08-16T07:16:50.546ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2932024-08-16T07:16:50.572ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2942024-08-16T07:16:50.573ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2952024-08-16T07:16:50.585ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:64556
2962024-08-16T07:16:50.586ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2972024-08-16T07:16:50.586ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2982024-08-16T07:16:50.586ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:48494
2992024-08-16T07:16:50.587ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3002024-08-16T07:16:50.587ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3012024-08-16T07:16:50.588ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3022024-08-16T07:16:50.588ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3032024-08-16T07:16:50.589ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3042024-08-16T07:16:50.589ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64556 req_id = 953c7277-a328-4c72-b7e6-eb6820a385a3 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
3052024-08-16T07:16:50.589ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 4763b503-e682-42ca-b98d-9784fb066f27 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
3062024-08-16T07:16:50.590ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64556 req_id = 953c7277-a328-4c72-b7e6-eb6820a385a3 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
3072024-08-16T07:16:50.590ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 4763b503-e682-42ca-b98d-9784fb066f27 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
3082024-08-16T07:16:50.593ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
3092024-08-16T07:16:50.593ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3102024-08-16T07:16:50.593ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3112024-08-16T07:16:50.602ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 14938 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 4763b503-e682-42ca-b98d-9784fb066f27 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
3122024-08-16T07:16:50.616ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 29681 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64556 req_id = 953c7277-a328-4c72-b7e6-eb6820a385a3 response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
3132024-08-16T07:16:50.622ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3142024-08-16T07:16:50.622ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3152024-08-16T07:16:50.623ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3162024-08-16T07:16:50.623ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3172024-08-16T07:16:50.624ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3182024-08-16T07:16:50.624ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3192024-08-16T07:16:50.625ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3202024-08-16T07:16:50.625ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3212024-08-16T07:16:50.626ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3222024-08-16T07:16:50.629ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
3232024-08-16T07:16:50.637ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3242024-08-16T07:16:50.637ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3252024-08-16T07:16:50.657ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3262024-08-16T07:16:50.657ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3272024-08-16T07:16:50.661ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3282024-08-16T07:16:50.661ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3292024-08-16T07:16:50.662ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3302024-08-16T07:16:50.662ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3312024-08-16T07:16:50.663ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3322024-08-16T07:16:50.663ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3332024-08-16T07:16:50.664ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3342024-08-16T07:16:50.667ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
3352024-08-16T07:16:50.667ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3362024-08-16T07:16:50.667ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3372024-08-16T07:16:50.696ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3382024-08-16T07:16:50.696ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3392024-08-16T07:16:50.697ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3402024-08-16T07:16:50.697ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3412024-08-16T07:16:50.698ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3422024-08-16T07:16:50.698ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3432024-08-16T07:16:50.699ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3442024-08-16T07:16:50.699ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3452024-08-16T07:16:50.700ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3462024-08-16T07:16:50.702ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
3472024-08-16T07:16:50.707ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3482024-08-16T07:16:50.707ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3492024-08-16T07:16:50.716ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3502024-08-16T07:16:50.717ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3512024-08-16T07:16:50.721ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3522024-08-16T07:16:50.721ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3532024-08-16T07:16:50.722ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3542024-08-16T07:16:50.722ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3552024-08-16T07:16:50.723ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3562024-08-16T07:16:50.723ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3572024-08-16T07:16:50.723ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3582024-08-16T07:16:50.726ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
3592024-08-16T07:16:50.726ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3602024-08-16T07:16:50.726ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3612024-08-16T07:16:50.733ZINFOnexus (DataLoader): created built-in services vpc subnets file = nexus/db-queries/src/db/datastore/vpc.rs:316
3622024-08-16T07:16:50.733ZINFOnexus (DataLoader): created built-in services vpc file = nexus/db-queries/src/db/datastore/vpc.rs:194
3632024-08-16T07:16:50.733ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3642024-08-16T07:16:50.734ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3652024-08-16T07:16:50.734ZDEBGnexus (DataLoader): attempting to create silo users
3662024-08-16T07:16:50.734ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3672024-08-16T07:16:50.734ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3682024-08-16T07:16:50.748ZINFOnexus (DataLoader): created 2 silo users file = nexus/db-queries/src/db/datastore/silo_user.rs:419
3692024-08-16T07:16:50.748ZDEBGnexus (DataLoader): attempting to create silo user role assignments
3702024-08-16T07:16:50.748ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3712024-08-16T07:16:50.749ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3722024-08-16T07:16:50.752ZINFOnexus (DataLoader): created 2 silo user role assignments file = nexus/db-queries/src/db/datastore/silo_user.rs:446
3732024-08-16T07:16:50.752ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3742024-08-16T07:16:50.752ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3752024-08-16T07:16:50.755ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3762024-08-16T07:16:50.756ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3772024-08-16T07:16:50.760ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3782024-08-16T07:16:50.760ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3792024-08-16T07:16:50.761ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3802024-08-16T07:16:50.762ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = IpPoolList result = Ok(())
3812024-08-16T07:16:50.762ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3822024-08-16T07:16:50.762ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3832024-08-16T07:16:50.788ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3842024-08-16T07:16:50.788ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3852024-08-16T07:16:50.789ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3862024-08-16T07:16:50.790ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = IpPoolList result = Ok(())
3872024-08-16T07:16:50.790ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3882024-08-16T07:16:50.790ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3892024-08-16T07:16:50.852ZINFOnexus: populate complete file = nexus/src/app/mod.rs:513
3902024-08-16T07:16:50.852ZINFOnexus: activating background tasks file = nexus/src/app/mod.rs:522
3912024-08-16T07:16:50.859ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 1 reason = Timeout
3922024-08-16T07:16:50.859ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 1 reason = Timeout
3932024-08-16T07:16:50.859ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 1 reason = Timeout
3942024-08-16T07:16:50.859ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 1 reason = Timeout
3952024-08-16T07:16:50.859ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 1 reason = Timeout
3962024-08-16T07:16:50.859ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 1 reason = Timeout
3972024-08-16T07:16:50.859ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 1 reason = Timeout
3982024-08-16T07:16:50.859ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 1 reason = Timeout
3992024-08-16T07:16:50.859ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 1 reason = Timeout
4002024-08-16T07:16:50.859ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 1 reason = Timeout
4012024-08-16T07:16:50.859ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 1 reason = Timeout
4022024-08-16T07:16:50.859ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 1 reason = Timeout
4032024-08-16T07:16:50.859ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
4042024-08-16T07:16:50.859ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
4052024-08-16T07:16:50.859ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 1 reason = Timeout
4062024-08-16T07:16:50.859ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 1 reason = Timeout
4072024-08-16T07:16:50.859ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
4082024-08-16T07:16:50.859ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
4092024-08-16T07:16:50.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4102024-08-16T07:16:50.859ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 1 reason = Timeout
4112024-08-16T07:16:50.859ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
4122024-08-16T07:16:50.859ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = crdb_node_id_collector file = nexus/src/app/background/tasks/crdb_node_id_collector.rs:78 reason = no blueprint
4132024-08-16T07:16:50.859ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:61 reason = no config nor servers
4142024-08-16T07:16:50.859ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:60 reason = no blueprint
4152024-08-16T07:16:50.859ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
4162024-08-16T07:16:50.859ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
4172024-08-16T07:16:50.859ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
4182024-08-16T07:16:50.859ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
4192024-08-16T07:16:50.859ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 283.196\u{b5}s iteration = 1 status = {"error":"no blueprint"}
4202024-08-16T07:16:50.859ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 290.016\u{b5}s iteration = 1 status = {"error":"no config nor servers"}
4212024-08-16T07:16:50.859ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 2.345604ms iteration = 1 status = {"error":"no blueprint"}
4222024-08-16T07:16:50.859ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-08-16 07:06:50.859880889 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
4232024-08-16T07:16:50.861ZWARNnexus (BackgroundTasks): phantom disk task started background_task = phantom_disks file = nexus/src/app/background/tasks/phantom_disks.rs:46
4242024-08-16T07:16:50.861ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
4252024-08-16T07:16:50.861ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
4262024-08-16T07:16:50.861ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 1 reason = Timeout
4272024-08-16T07:16:50.862ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
4282024-08-16T07:16:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
4292024-08-16T07:16:50.862ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 1 reason = Timeout
4302024-08-16T07:16:50.862ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:61 reason = no config nor servers
4312024-08-16T07:16:50.862ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 221.465\u{b5}s iteration = 1 status = {"error":"no config nor servers"}
4322024-08-16T07:16:50.863ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 1 reason = Timeout
4332024-08-16T07:16:50.863ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 1 reason = Timeout
4342024-08-16T07:16:50.863ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
4352024-08-16T07:16:50.863ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 1 reason = Timeout
4362024-08-16T07:16:50.863ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
4372024-08-16T07:16:50.863ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 1 reason = Timeout
4382024-08-16T07:16:50.863ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 1 reason = Timeout
4392024-08-16T07:16:50.863ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
4402024-08-16T07:16:50.863ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4412024-08-16T07:16:50.863ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 1 reason = Timeout
4422024-08-16T07:16:50.863ZINFOnexus (BackgroundTasks): region snapshot replacement start task started background_task = region_snapshot_replacement_start file = nexus/src/app/background/tasks/region_snapshot_replacement_start.rs:236
4432024-08-16T07:16:50.863ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4442024-08-16T07:16:50.863ZWARNnexus (BackgroundTasks): region replacement task started background_task = region_replacement file = nexus/src/app/background/tasks/region_replacement.rs:64
4452024-08-16T07:16:50.863ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 1 reason = Timeout
4462024-08-16T07:16:50.863ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
4472024-08-16T07:16:50.863ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
4482024-08-16T07:16:50.863ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
4492024-08-16T07:16:50.863ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
4502024-08-16T07:16:50.863ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 1 reason = Timeout
4512024-08-16T07:16:50.863ZINFOnexus (BackgroundTasks): lookup region port task started background_task = lookup_region_port file = nexus/src/app/background/tasks/lookup_region_port.rs:56
4522024-08-16T07:16:50.863ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
4532024-08-16T07:16:50.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
4542024-08-16T07:16:50.863ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 1 reason = Timeout
4552024-08-16T07:16:50.863ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 1 reason = Timeout
4562024-08-16T07:16:50.863ZINFOnexus (BackgroundTasks): region snapshot replacement garbage collect task started background_task = region_snapshot_replacement_garbage_collection file = nexus/src/app/background/tasks/region_snapshot_replacement_garbage_collect.rs:133
4572024-08-16T07:16:50.863ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 1 reason = Timeout
4582024-08-16T07:16:50.863ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 1 reason = Timeout
4592024-08-16T07:16:50.863ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
4602024-08-16T07:16:50.863ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 1 reason = Timeout
4612024-08-16T07:16:50.863ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
4622024-08-16T07:16:50.863ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 1 reason = Timeout
4632024-08-16T07:16:50.863ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
4642024-08-16T07:16:50.863ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4652024-08-16T07:16:50.863ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
4662024-08-16T07:16:50.863ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4672024-08-16T07:16:50.863ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
4682024-08-16T07:16:50.865ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("dec19c15-1a2d-47ac-9b9e-9f424d3a3464.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f9649eef-936b-4765-9810-da8662275db5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f9649eef-936b-4765-9810-da8662275db5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1074, tv_nsec: 239089937 } })
4692024-08-16T07:16:50.865ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6d6264ea-5d56-4938-8c26-581ed0b9907b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a8440aa3-608b-4c08-b70c-6d92a9461396.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("aea2243f-052e-4953-bdfa-7c3368895dd2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("aea2243f-052e-4953-bdfa-7c3368895dd2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1074, tv_nsec: 239356783 } })
4702024-08-16T07:16:50.865ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4712024-08-16T07:16:50.865ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
4722024-08-16T07:16:50.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4732024-08-16T07:16:50.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
4742024-08-16T07:16:50.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
4752024-08-16T07:16:50.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4762024-08-16T07:16:50.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
4772024-08-16T07:16:50.867ZINFOnexus (BackgroundTasks): Abandoned VMM reaper running background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:76
4782024-08-16T07:16:50.867ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
4792024-08-16T07:16:50.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
4802024-08-16T07:16:50.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
4812024-08-16T07:16:50.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
4822024-08-16T07:16:50.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
4832024-08-16T07:16:50.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
4842024-08-16T07:16:50.867ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
4852024-08-16T07:16:50.868ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
4862024-08-16T07:16:50.868ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
4872024-08-16T07:16:50.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
4882024-08-16T07:16:50.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
4892024-08-16T07:16:50.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
4902024-08-16T07:16:50.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
4912024-08-16T07:16:50.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
4922024-08-16T07:16:50.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
4932024-08-16T07:16:50.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
4942024-08-16T07:16:50.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
4952024-08-16T07:16:50.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
4962024-08-16T07:16:50.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4972024-08-16T07:16:50.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
4982024-08-16T07:16:50.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4992024-08-16T07:16:50.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
5002024-08-16T07:16:50.873ZINFOnexus (BackgroundTasks): found DNS servers (initial) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external dns_group = external file = nexus/src/app/background/tasks/dns_servers.rs:113
5012024-08-16T07:16:50.873ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 16.484571ms iteration = 1 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
5022024-08-16T07:16:50.873ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 2 reason = Dependency
5032024-08-16T07:16:50.873ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
5042024-08-16T07:16:50.873ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 4.78\u{b5}s iteration = 2 status = {"error":"no config"}
5052024-08-16T07:16:50.874ZINFOnexus (BackgroundTasks): found DNS servers (initial) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal dns_group = internal file = nexus/src/app/background/tasks/dns_servers.rs:113
5062024-08-16T07:16:50.874ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 17.097365ms iteration = 1 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
5072024-08-16T07:16:50.874ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 2 reason = Dependency
5082024-08-16T07:16:50.874ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
5092024-08-16T07:16:50.874ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 3.751\u{b5}s iteration = 2 status = {"error":"no config"}
5102024-08-16T07:16:50.875ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
5112024-08-16T07:16:50.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
5122024-08-16T07:16:50.882ZWARNnexus (BackgroundTasks): phantom disk task done background_task = phantom_disks file = nexus/src/app/background/tasks/phantom_disks.rs:93
5132024-08-16T07:16:50.882ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 25.10441ms iteration = 1 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
5142024-08-16T07:16:50.883ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5152024-08-16T07:16:50.885ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
5162024-08-16T07:16:50.885ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
5172024-08-16T07:16:50.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
5182024-08-16T07:16:50.891ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 4bbef48f-2f0b-4830-a60d-99d66896a761 roles = RoleSet { roles: {} } uri = /sled-agents/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
5192024-08-16T07:16:50.892ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 4bbef48f-2f0b-4830-a60d-99d66896a761 resource = Database result = Ok(()) uri = /sled-agents/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
5202024-08-16T07:16:50.897ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1074, tv_nsec: 272916558 } })
5212024-08-16T07:16:50.898ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
5222024-08-16T07:16:50.903ZINFOnexus (BackgroundTasks): lookup region port task done background_task = lookup_region_port file = nexus/src/app/background/tasks/lookup_region_port.rs:150
5232024-08-16T07:16:50.903ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 40.103806ms iteration = 1 status = {"errors":[],"found_port_ok":[]}
5242024-08-16T07:16:50.904ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-08-16 07:06:50.859880889 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
5252024-08-16T07:16:50.904ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 47.101508ms iteration = 1 status = {"expiration":"2024-08-16T07:06:50.859880889Z","pruned":[]}
5262024-08-16T07:16:50.912ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1074, tv_nsec: 287774181 } })
5272024-08-16T07:16:50.912ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
5282024-08-16T07:16:50.913ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
5292024-08-16T07:16:50.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5302024-08-16T07:16:50.915ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5312024-08-16T07:16:50.915ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = []
5322024-08-16T07:16:50.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5332024-08-16T07:16:50.916ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1074, tv_nsec: 291665401 } })
5342024-08-16T07:16:50.916ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5352024-08-16T07:16:50.917ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5362024-08-16T07:16:50.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5372024-08-16T07:16:50.919ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
5382024-08-16T07:16:50.919ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5392024-08-16T07:16:50.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5402024-08-16T07:16:50.922ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5412024-08-16T07:16:50.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5422024-08-16T07:16:50.932ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5432024-08-16T07:16:50.934ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
5442024-08-16T07:16:50.934ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
5452024-08-16T07:16:50.934ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5462024-08-16T07:16:50.936ZINFOnexus (BackgroundTasks): Physical Disk Adoption: Rack not yet initialized background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:79 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
5472024-08-16T07:16:50.936ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 77.288945ms iteration = 1 status = {"error":"rack not yet initialized: e1b0d583-7b20-4a4b-97f9-9f83300aeb7a"}
5482024-08-16T07:16:50.937ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5492024-08-16T07:16:50.938ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5502024-08-16T07:16:50.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5512024-08-16T07:16:50.939ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
5522024-08-16T07:16:50.939ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
5532024-08-16T07:16:50.939ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5542024-08-16T07:16:50.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
5552024-08-16T07:16:50.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5562024-08-16T07:16:50.950ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:438
5572024-08-16T07:16:50.950ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 87.168024ms iteration = 1 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":0,"recent_failures":[],"recent_recoveries":[]}
5582024-08-16T07:16:50.961ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
5592024-08-16T07:16:50.961ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
5602024-08-16T07:16:50.961ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "dcac256a-c5ab-4699-9a37-d22301c0a89f", "content-length": "26", "date": "Fri, 16 Aug 2024 07:16:50 GMT"} })
5612024-08-16T07:16:50.969ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
5622024-08-16T07:16:50.970ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
5632024-08-16T07:16:50.974ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5642024-08-16T07:16:50.974ZINFOnexus (BackgroundTasks): region snapshot replacement garbage collect task done background_task = region_snapshot_replacement_garbage_collection file = nexus/src/app/background/tasks/region_snapshot_replacement_garbage_collect.rs:147
5652024-08-16T07:16:50.974ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 111.334301ms iteration = 1 status = {"errors":[],"garbage_collect_requested":[]}
5662024-08-16T07:16:50.975ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
5672024-08-16T07:16:50.975ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5682024-08-16T07:16:50.975ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 112.290623ms iteration = 1 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
5692024-08-16T07:16:50.978ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
5702024-08-16T07:16:50.978ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
5712024-08-16T07:16:50.978ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
5722024-08-16T07:16:50.979ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5732024-08-16T07:16:50.982ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
5742024-08-16T07:16:50.982ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
5752024-08-16T07:16:50.986ZWARNnexus (BackgroundTasks): failed to read target blueprint background_task = blueprint_loader error = Internal Error: no target blueprint set file = nexus/src/app/background/tasks/blueprint_load.rs:69
5762024-08-16T07:16:50.986ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 129.156683ms iteration = 1 status = {"error":"failed to read target blueprint: Internal Error: no target blueprint set"}
5772024-08-16T07:16:50.998ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
5782024-08-16T07:16:50.998ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
5792024-08-16T07:16:50.999ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "bb223554-89c0-47f1-9007-5429c8ae8fc2", "content-length": "26", "date": "Fri, 16 Aug 2024 07:16:50 GMT"} })
5802024-08-16T07:16:50.999ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
5812024-08-16T07:16:51.000ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
5822024-08-16T07:16:51.004ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5832024-08-16T07:16:51.006ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
5842024-08-16T07:16:51.006ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
5852024-08-16T07:16:51.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
5862024-08-16T07:16:51.006ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
5872024-08-16T07:16:51.006ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
5882024-08-16T07:16:51.006ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
5892024-08-16T07:16:51.007ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/ignition", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ab856b1e-ae7d-48b6-af4e-5054714eebfe", "content-length": "476", "date": "Fri, 16 Aug 2024 07:16:50 GMT"} })
5902024-08-16T07:16:51.009ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
5912024-08-16T07:16:51.009ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
5922024-08-16T07:16:51.009ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 145.544981ms iteration = 1 status = {"error":null,"error_count":0,"found":0,"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0}
5932024-08-16T07:16:51.010ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5942024-08-16T07:16:51.012ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
5952024-08-16T07:16:51.012ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5962024-08-16T07:16:51.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5972024-08-16T07:16:51.014ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 150.557388ms iteration = 1 status = {}
5982024-08-16T07:16:51.017ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5992024-08-16T07:16:51.018ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
6002024-08-16T07:16:51.019ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
6012024-08-16T07:16:51.019ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
6022024-08-16T07:16:51.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
6032024-08-16T07:16:51.021ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "463f1f04-5d23-4e73-8d34-6e2b24a2c67d", "content-length": "734", "date": "Fri, 16 Aug 2024 07:16:50 GMT"} })
6042024-08-16T07:16:51.025ZINFOnexus (BackgroundTasks): region snapshot replacement start task done background_task = region_snapshot_replacement_start file = nexus/src/app/background/tasks/region_snapshot_replacement_start.rs:252
6052024-08-16T07:16:51.025ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 161.859488ms iteration = 1 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
6062024-08-16T07:16:51.025ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
6072024-08-16T07:16:51.025ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/sp/caboose", query: Some("firmware_slot=0"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "84a232d6-5aa8-458c-83f4-1a6ec2db70eb", "content-length": "86", "date": "Fri, 16 Aug 2024 07:16:50 GMT"} })
6082024-08-16T07:16:51.026ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
6092024-08-16T07:16:51.026ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6102024-08-16T07:16:51.026ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/sp/caboose", query: Some("firmware_slot=1"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "4130b5b0-6455-46eb-adea-171f578d7768", "content-length": "86", "date": "Fri, 16 Aug 2024 07:16:50 GMT"} })
6112024-08-16T07:16:51.026ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
6122024-08-16T07:16:51.026ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/rot/caboose", query: Some("firmware_slot=0"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "4e8382eb-b423-4d48-86d1-a5f57cb497e1", "content-length": "80", "date": "Fri, 16 Aug 2024 07:16:50 GMT"} })
6132024-08-16T07:16:51.026ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
6142024-08-16T07:16:51.027ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/rot/caboose", query: Some("firmware_slot=1"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f33e5b7e-16d3-488f-b9b4-bd872fb9a04f", "content-length": "80", "date": "Fri, 16 Aug 2024 07:16:50 GMT"} })
6152024-08-16T07:16:51.027ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
6162024-08-16T07:16:51.027ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/stage0/caboose", query: Some("firmware_slot=0"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f12f8cf9-9641-45b9-8a6f-c68f54426eb2", "content-length": "88", "date": "Fri, 16 Aug 2024 07:16:50 GMT"} })
6172024-08-16T07:16:51.027ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
6182024-08-16T07:16:51.027ZINFOnexus (dropshot_internal): request completed error_message_external = not found: sled with id "03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae" error_message_internal = not found: sled with id "03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae" file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:902 latency_us = 135601 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 4bbef48f-2f0b-4830-a60d-99d66896a761 response_code = 404 uri = /sled-agents/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
6192024-08-16T07:16:51.028ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
6202024-08-16T07:16:51.028ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6212024-08-16T07:16:51.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6222024-08-16T07:16:51.028ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/stage0/caboose", query: Some("firmware_slot=1"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6a69e46d-a4d1-467c-b18d-4856b57e5a3c", "content-length": "88", "date": "Fri, 16 Aug 2024 07:16:50 GMT"} })
6232024-08-16T07:16:51.028ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
6242024-08-16T07:16:51.029ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6252024-08-16T07:16:51.030ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6262024-08-16T07:16:51.032ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
6272024-08-16T07:16:51.032ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6282024-08-16T07:16:51.032ZWARNnexus (BackgroundTasks): region replacement task done background_task = region_replacement file = nexus/src/app/background/tasks/region_replacement.rs:185
6292024-08-16T07:16:51.032ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 169.136186ms iteration = 1 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
6302024-08-16T07:16:51.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6312024-08-16T07:16:51.032ZWARNnexus (BackgroundTasks): failed to read Silo/DNS/TLS configuration background_task = external_endpoints error = Internal Error: expected at least one external DNS zone file = nexus/src/app/background/tasks/external_endpoints.rs:48
6322024-08-16T07:16:51.032ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 175.980744ms iteration = 1 status = {"error":"failed to read Silo/DNS/TLS configuration: Internal Error: expected at least one external DNS zone"}
6332024-08-16T07:16:51.033ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/rot/cmpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f83d6bb9-e30d-4be6-a136-3efae4057587", "content-length": "702", "date": "Fri, 16 Aug 2024 07:16:50 GMT"} })
6342024-08-16T07:16:51.033ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
6352024-08-16T07:16:51.033ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6362024-08-16T07:16:51.033ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
6372024-08-16T07:16:51.034ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6382024-08-16T07:16:51.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6392024-08-16T07:16:51.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6402024-08-16T07:16:51.035ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6412024-08-16T07:16:51.035ZWARNnexus (BackgroundTasks): failed to read DNS config background_task = dns_config_external dns_group = external error = Internal Error: expected exactly one latest version for DNS group External, found 0 file = nexus/src/app/background/tasks/dns_config.rs:72
6422024-08-16T07:16:51.035ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 178.312488ms iteration = 1 status = {"error":"failed to read DNS config: Internal Error: expected exactly one latest version for DNS group External, found 0"}
6432024-08-16T07:16:51.035ZWARNnexus (BackgroundTasks): inventory collection is None background_task = service_zone_nat_tracker file = nexus/src/app/background/tasks/sync_service_zone_nat.rs:95
6442024-08-16T07:16:51.035ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 171.940381ms iteration = 1 status = {"error":"inventory collection is None"}
6452024-08-16T07:16:51.038ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
6462024-08-16T07:16:51.038ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6472024-08-16T07:16:51.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6482024-08-16T07:16:51.039ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6492024-08-16T07:16:51.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6502024-08-16T07:16:51.040ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6512024-08-16T07:16:51.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6522024-08-16T07:16:51.041ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6532024-08-16T07:16:51.045ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
6542024-08-16T07:16:51.045ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
6552024-08-16T07:16:51.045ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6562024-08-16T07:16:51.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6572024-08-16T07:16:51.047ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/rot/cfpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "5cf75745-8182-475c-8e5c-660757e46588", "content-length": "727", "date": "Fri, 16 Aug 2024 07:16:50 GMT"} })
6582024-08-16T07:16:51.047ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6592024-08-16T07:16:51.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6602024-08-16T07:16:51.048ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c2cb3755-e966-4885-aaf4-2536e9610555", "content-length": "1", "date": "Fri, 16 Aug 2024 07:16:50 GMT"} })
6612024-08-16T07:16:51.049ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
6622024-08-16T07:16:51.049ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/rot/cfpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "aa8658ca-b76a-4bd5-bc13-ec188b5836ff", "content-length": "729", "date": "Fri, 16 Aug 2024 07:16:50 GMT"} })
6632024-08-16T07:16:51.049ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
6642024-08-16T07:16:51.049ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
6652024-08-16T07:16:51.049ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/rot/cfpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e748307a-8b65-48ab-b42c-0df368d46d9b", "content-length": "728", "date": "Fri, 16 Aug 2024 07:16:51 GMT"} })
6662024-08-16T07:16:51.049ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
6672024-08-16T07:16:51.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
6682024-08-16T07:16:51.050ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "77890f0d-181f-4ba8-9faf-1947b61d1d58", "content-length": "722", "date": "Fri, 16 Aug 2024 07:16:51 GMT"} })
6692024-08-16T07:16:51.050ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
6702024-08-16T07:16:51.051ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/sp/caboose", query: Some("firmware_slot=0"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "782b00f8-3da6-4627-a5c0-cc3aa036c81e", "content-length": "84", "date": "Fri, 16 Aug 2024 07:16:51 GMT"} })
6712024-08-16T07:16:51.051ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
6722024-08-16T07:16:51.051ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/sp/caboose", query: Some("firmware_slot=1"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "2a8bf4d9-818f-4ccd-b6e6-5186edc9d011", "content-length": "84", "date": "Fri, 16 Aug 2024 07:16:51 GMT"} })
6732024-08-16T07:16:51.051ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
6742024-08-16T07:16:51.051ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/rot/caboose", query: Some("firmware_slot=0"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "fa6edcb5-a13c-45f8-b899-cb973e9a3e4d", "content-length": "82", "date": "Fri, 16 Aug 2024 07:16:51 GMT"} })
6752024-08-16T07:16:51.051ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
6762024-08-16T07:16:51.051ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/rot/caboose", query: Some("firmware_slot=1"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "cc0b073e-78e1-46c9-8a4b-0efdd5aec93d", "content-length": "82", "date": "Fri, 16 Aug 2024 07:16:51 GMT"} })
6772024-08-16T07:16:51.051ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
6782024-08-16T07:16:51.052ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/stage0/caboose", query: Some("firmware_slot=0"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "83ae3ef3-9775-463c-8422-2ee8580fa5db", "content-length": "91", "date": "Fri, 16 Aug 2024 07:16:51 GMT"} })
6792024-08-16T07:16:51.052ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
6802024-08-16T07:16:51.052ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/stage0/caboose", query: Some("firmware_slot=1"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ff7c212b-8ca1-4516-963f-3a9c56a739b1", "content-length": "91", "date": "Fri, 16 Aug 2024 07:16:51 GMT"} })
6812024-08-16T07:16:51.052ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
6822024-08-16T07:16:51.053ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/rot/cmpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "68e3c95e-9d11-4a8e-845f-078a705e0ae5", "content-length": "702", "date": "Fri, 16 Aug 2024 07:16:51 GMT"} })
6832024-08-16T07:16:51.053ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
6842024-08-16T07:16:51.053ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/rot/cfpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "3138a18d-c56f-4dd1-a3f1-f61f9d77e74c", "content-length": "727", "date": "Fri, 16 Aug 2024 07:16:50 GMT"} })
6852024-08-16T07:16:51.053ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
6862024-08-16T07:16:51.053ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/rot/cfpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c982f461-47f9-4579-98c5-3e0718699d17", "content-length": "729", "date": "Fri, 16 Aug 2024 07:16:51 GMT"} })
6872024-08-16T07:16:51.053ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
6882024-08-16T07:16:51.053ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/rot/cfpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ba14d7bc-563f-4ab6-a365-bd82437fc7f3", "content-length": "728", "date": "Fri, 16 Aug 2024 07:16:51 GMT"} })
6892024-08-16T07:16:51.053ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
6902024-08-16T07:16:51.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
6912024-08-16T07:16:51.054ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
6922024-08-16T07:16:51.054ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
6932024-08-16T07:16:51.054ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 196.415136ms iteration = 1 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
6942024-08-16T07:16:51.055ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6952024-08-16T07:16:51.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6962024-08-16T07:16:51.059ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6972024-08-16T07:16:51.059ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6982024-08-16T07:16:51.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6992024-08-16T07:16:51.061ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
7002024-08-16T07:16:51.061ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
7012024-08-16T07:16:51.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
7022024-08-16T07:16:51.061ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 204.699197ms iteration = 1 status = null
7032024-08-16T07:16:51.063ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 206.222913ms iteration = 1 status = {}
7042024-08-16T07:16:51.069ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7052024-08-16T07:16:51.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7062024-08-16T07:16:51.071ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7072024-08-16T07:16:51.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7082024-08-16T07:16:51.072ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7092024-08-16T07:16:51.072ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7102024-08-16T07:16:51.072ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
7112024-08-16T07:16:51.072ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 209.16281ms iteration = 1 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
7122024-08-16T07:16:51.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7132024-08-16T07:16:51.073ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7142024-08-16T07:16:51.074ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
7152024-08-16T07:16:51.074ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
7162024-08-16T07:16:51.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
7172024-08-16T07:16:51.076ZWARNnexus (BackgroundTasks): failed to read DNS config background_task = dns_config_internal dns_group = internal error = Internal Error: expected exactly one latest version for DNS group Internal, found 0 file = nexus/src/app/background/tasks/dns_config.rs:72
7182024-08-16T07:16:51.076ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
7192024-08-16T07:16:51.076ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 219.658043ms iteration = 1 status = {"error":"failed to read DNS config: Internal Error: expected exactly one latest version for DNS group Internal, found 0"}
7202024-08-16T07:16:51.076ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7212024-08-16T07:16:51.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7222024-08-16T07:16:51.077ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7232024-08-16T07:16:51.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7242024-08-16T07:16:51.079ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7252024-08-16T07:16:51.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7262024-08-16T07:16:51.079ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
7272024-08-16T07:16:51.079ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
7282024-08-16T07:16:51.079ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
7292024-08-16T07:16:51.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
7302024-08-16T07:16:51.079ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7312024-08-16T07:16:51.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7322024-08-16T07:16:51.080ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7332024-08-16T07:16:51.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7342024-08-16T07:16:51.082ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7352024-08-16T07:16:51.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7362024-08-16T07:16:51.083ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7372024-08-16T07:16:51.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7382024-08-16T07:16:51.084ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7392024-08-16T07:16:51.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7402024-08-16T07:16:51.085ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7412024-08-16T07:16:51.088ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
7422024-08-16T07:16:51.088ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7432024-08-16T07:16:51.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7442024-08-16T07:16:51.116ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 253.172027ms iteration = 1 status = {}
7452024-08-16T07:16:51.123ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7462024-08-16T07:16:51.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7472024-08-16T07:16:51.124ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7482024-08-16T07:16:51.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7492024-08-16T07:16:51.134ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
7502024-08-16T07:16:51.134ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
7512024-08-16T07:16:51.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
7522024-08-16T07:16:51.136ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7532024-08-16T07:16:51.137ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
7542024-08-16T07:16:51.141ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
7552024-08-16T07:16:51.141ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
7562024-08-16T07:16:51.146ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
7572024-08-16T07:16:51.146ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
7582024-08-16T07:16:51.146ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 283.542099ms iteration = 1 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
7592024-08-16T07:16:51.157ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7602024-08-16T07:16:51.161ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
7612024-08-16T07:16:51.161ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7622024-08-16T07:16:51.161ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7632024-08-16T07:16:51.169ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7642024-08-16T07:16:51.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7652024-08-16T07:16:51.170ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7662024-08-16T07:16:51.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7672024-08-16T07:16:51.171ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7682024-08-16T07:16:51.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7692024-08-16T07:16:51.172ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7702024-08-16T07:16:51.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7712024-08-16T07:16:51.173ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7722024-08-16T07:16:51.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7732024-08-16T07:16:51.174ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7742024-08-16T07:16:51.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7752024-08-16T07:16:51.175ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7762024-08-16T07:16:51.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7772024-08-16T07:16:51.176ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7782024-08-16T07:16:51.180ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
7792024-08-16T07:16:51.180ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7802024-08-16T07:16:51.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7812024-08-16T07:16:51.181ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7822024-08-16T07:16:51.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7832024-08-16T07:16:51.182ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7842024-08-16T07:16:51.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7852024-08-16T07:16:51.183ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7862024-08-16T07:16:51.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7872024-08-16T07:16:51.183ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7882024-08-16T07:16:51.184ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7892024-08-16T07:16:51.186ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
7902024-08-16T07:16:51.186ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7912024-08-16T07:16:51.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7922024-08-16T07:16:51.187ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
7932024-08-16T07:16:51.187ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7942024-08-16T07:16:51.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7952024-08-16T07:16:51.189ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7962024-08-16T07:16:51.191ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
7972024-08-16T07:16:51.192ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7982024-08-16T07:16:51.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7992024-08-16T07:16:51.195ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 332.019998ms iteration = 1 status = {}
8002024-08-16T07:16:51.196ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
8012024-08-16T07:16:51.197ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8022024-08-16T07:16:51.197ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8032024-08-16T07:16:51.198ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8042024-08-16T07:16:51.200ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
8052024-08-16T07:16:51.200ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8062024-08-16T07:16:51.200ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8072024-08-16T07:16:51.218ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
8082024-08-16T07:16:51.218ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = []
8092024-08-16T07:16:51.218ZDEBGnexus (service-firewall-rule-progator): resolved 0 rules for sleds background_task = service_firewall_rule_propagation
8102024-08-16T07:16:51.322ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = []
8112024-08-16T07:16:51.322ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
8122024-08-16T07:16:51.322ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 0 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
8132024-08-16T07:16:51.322ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 459.101023ms
8142024-08-16T07:16:51.322ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 459.112053ms iteration = 1 status = {}
8152024-08-16T07:16:51.348ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = 183e9c68-5ee3-40fd-a109-c2a10df0c73a file = nexus/db-queries/src/db/datastore/inventory.rs:893
8162024-08-16T07:16:51.349ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = 183e9c68-5ee3-40fd-a109-c2a10df0c73a time_started = 2024-08-16 07:16:51.006163 UTC
8172024-08-16T07:16:51.350ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 491.052241ms iteration = 1 status = {"collection_id":"183e9c68-5ee3-40fd-a109-c2a10df0c73a","time_done":"2024-08-16 07:16:51.134838 UTC","time_started":"2024-08-16 07:16:51.006163 UTC"}
8182024-08-16T07:16:51.350ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 2 reason = Dependency
8192024-08-16T07:16:51.350ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
8202024-08-16T07:16:51.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
8212024-08-16T07:16:51.351ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8222024-08-16T07:16:51.354ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
8232024-08-16T07:16:51.354ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
8242024-08-16T07:16:51.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
8252024-08-16T07:16:51.356ZINFOnexus (BackgroundTasks): Physical Disk Adoption: Rack not yet initialized background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:79 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
8262024-08-16T07:16:51.356ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 6.0609ms iteration = 2 status = {"error":"rack not yet initialized: e1b0d583-7b20-4a4b-97f9-9f83300aeb7a"}
8272024-08-16T07:16:51.625ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = e5efaffd-190d-4d3e-91ba-00df1a13bab6 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
8282024-08-16T07:16:51.625ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = e5efaffd-190d-4d3e-91ba-00df1a13bab6 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
8292024-08-16T07:16:51.626ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1790 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = e5efaffd-190d-4d3e-91ba-00df1a13bab6 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
8302024-08-16T07:16:51.705ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8312024-08-16T07:16:51.705ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8322024-08-16T07:16:51.706ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8332024-08-16T07:16:51.706ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8342024-08-16T07:16:51.707ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8352024-08-16T07:16:51.710ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: e1b0d583-7b20-4a4b-97f9-9f83300aeb7a, lookup_type: ById(e1b0d583-7b20-4a4b-97f9-9f83300aeb7a) } result = Ok(())
8362024-08-16T07:16:51.710ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: e1b0d583-7b20-4a4b-97f9-9f83300aeb7a, time_created: 2024-08-16T07:16:50.755850Z, time_modified: 2024-08-16T07:16:50.755850Z }, initialized: false, tuf_base_url: None, rack_subnet: None } file = nexus/src/app/rack.rs:726
8372024-08-16T07:16:52.647ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 53d3449a-b8a9-4bbd-b220-18feeecf63fb roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
8382024-08-16T07:16:52.648ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 53d3449a-b8a9-4bbd-b220-18feeecf63fb resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
8392024-08-16T07:16:52.649ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2018 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 53d3449a-b8a9-4bbd-b220-18feeecf63fb response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
8402024-08-16T07:16:52.894ZINFOnexus: registered sled agent file = nexus/src/app/sled.rs:53 sled_uuid = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
8412024-08-16T07:16:52.958ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 67063 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:48494 req_id = d1825128-8c1e-4154-95d3-3b4ef1a05e57 response_code = 204 uri = /sled-agents/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
8422024-08-16T07:16:52.958ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 2 reason = Signaled
8432024-08-16T07:16:52.958ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
8442024-08-16T07:16:52.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
8452024-08-16T07:16:52.960ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8462024-08-16T07:16:52.961ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
8472024-08-16T07:16:52.961ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
8482024-08-16T07:16:52.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
8492024-08-16T07:16:52.964ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(183e9c68-5ee3-40fd-a109-c2a10df0c73a, 0), (553e2faf-30c0-4390-b228-b82c6e2a23da, 0), (1ac544de-8fad-4d7d-9f56-e60ff67ed4b9, 0)]
8502024-08-16T07:16:52.964ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1076, tv_nsec: 339984836 } })
8512024-08-16T07:16:52.997ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
8522024-08-16T07:16:52.997ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
8532024-08-16T07:16:52.997ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
8542024-08-16T07:16:52.999ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/ignition", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "881f3c55-b94b-4998-98d1-45763c211a5a", "content-length": "476", "date": "Fri, 16 Aug 2024 07:16:52 GMT"} })
8552024-08-16T07:16:52.999ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
8562024-08-16T07:16:52.999ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "8fd3883a-5f6d-4c60-bad0-d5c0e13cba8d", "content-length": "734", "date": "Fri, 16 Aug 2024 07:16:52 GMT"} })
8572024-08-16T07:16:52.999ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
8582024-08-16T07:16:52.999ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/sp/caboose", query: Some("firmware_slot=0"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "23696387-4719-4715-8012-229cbc36d605", "content-length": "86", "date": "Fri, 16 Aug 2024 07:16:52 GMT"} })
8592024-08-16T07:16:52.999ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
8602024-08-16T07:16:52.999ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/sp/caboose", query: Some("firmware_slot=1"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "42940f40-b82a-4e45-ba4a-9028d72a7bba", "content-length": "86", "date": "Fri, 16 Aug 2024 07:16:52 GMT"} })
8612024-08-16T07:16:52.999ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
8622024-08-16T07:16:53.000ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/rot/caboose", query: Some("firmware_slot=0"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "56e08299-11af-4148-96d9-cb85d210263e", "content-length": "80", "date": "Fri, 16 Aug 2024 07:16:52 GMT"} })
8632024-08-16T07:16:53.000ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
8642024-08-16T07:16:53.000ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/rot/caboose", query: Some("firmware_slot=1"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f60c388e-c824-46a6-9b1d-17631e1cbec4", "content-length": "80", "date": "Fri, 16 Aug 2024 07:16:52 GMT"} })
8652024-08-16T07:16:53.000ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
8662024-08-16T07:16:53.000ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/stage0/caboose", query: Some("firmware_slot=0"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "9cc91173-ab5e-4142-b128-a52c283d34c9", "content-length": "88", "date": "Fri, 16 Aug 2024 07:16:52 GMT"} })
8672024-08-16T07:16:53.000ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
8682024-08-16T07:16:53.001ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/stage0/caboose", query: Some("firmware_slot=1"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "9b3c612a-fd68-4342-8a52-0e4c5ab510c0", "content-length": "88", "date": "Fri, 16 Aug 2024 07:16:52 GMT"} })
8692024-08-16T07:16:53.001ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
8702024-08-16T07:16:53.001ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/rot/cmpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "76539ef5-1836-4157-9091-2ae6ab48f0b8", "content-length": "702", "date": "Fri, 16 Aug 2024 07:16:52 GMT"} })
8712024-08-16T07:16:53.001ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
8722024-08-16T07:16:53.001ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/rot/cfpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "4b8743ff-345b-48c6-9570-69680af6c52d", "content-length": "727", "date": "Fri, 16 Aug 2024 07:16:52 GMT"} })
8732024-08-16T07:16:53.001ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
8742024-08-16T07:16:53.001ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/rot/cfpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "eded9146-9cc8-4179-ac63-fd44593f2052", "content-length": "729", "date": "Fri, 16 Aug 2024 07:16:53 GMT"} })
8752024-08-16T07:16:53.002ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
8762024-08-16T07:16:53.002ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/rot/cfpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "95e63079-8cd2-42d9-8f33-97527f0308e9", "content-length": "728", "date": "Fri, 16 Aug 2024 07:16:52 GMT"} })
8772024-08-16T07:16:53.002ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
8782024-08-16T07:16:53.002ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "37ea44e9-d03d-42e6-95b4-2affb7d01c21", "content-length": "722", "date": "Fri, 16 Aug 2024 07:16:52 GMT"} })
8792024-08-16T07:16:53.002ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
8802024-08-16T07:16:53.003ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/sp/caboose", query: Some("firmware_slot=0"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6d312e5f-86b6-40d7-a43b-75cb301f492f", "content-length": "84", "date": "Fri, 16 Aug 2024 07:16:52 GMT"} })
8812024-08-16T07:16:53.003ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
8822024-08-16T07:16:53.003ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/sp/caboose", query: Some("firmware_slot=1"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b381948e-0af5-45f2-8d9b-6443da45a1a4", "content-length": "84", "date": "Fri, 16 Aug 2024 07:16:52 GMT"} })
8832024-08-16T07:16:53.003ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
8842024-08-16T07:16:53.003ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/rot/caboose", query: Some("firmware_slot=0"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "bb6d6cae-dcc7-4e00-ad83-c1ad5847cb3f", "content-length": "82", "date": "Fri, 16 Aug 2024 07:16:52 GMT"} })
8852024-08-16T07:16:53.003ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
8862024-08-16T07:16:53.004ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/rot/caboose", query: Some("firmware_slot=1"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "5aebd5fc-98a2-48f3-aafa-85eb1142570f", "content-length": "82", "date": "Fri, 16 Aug 2024 07:16:52 GMT"} })
8872024-08-16T07:16:53.004ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
8882024-08-16T07:16:53.004ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/stage0/caboose", query: Some("firmware_slot=0"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "2830f924-2873-4c77-9ff7-ebba6d58e170", "content-length": "91", "date": "Fri, 16 Aug 2024 07:16:52 GMT"} })
8892024-08-16T07:16:53.004ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
8902024-08-16T07:16:53.004ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/stage0/caboose", query: Some("firmware_slot=1"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "83fe9c98-a2d2-4eac-b801-a0bdcdd759bb", "content-length": "91", "date": "Fri, 16 Aug 2024 07:16:52 GMT"} })
8912024-08-16T07:16:53.004ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
8922024-08-16T07:16:53.005ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/rot/cmpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "9f393bf3-ae3f-4854-a60f-d88bf68d8847", "content-length": "702", "date": "Fri, 16 Aug 2024 07:16:52 GMT"} })
8932024-08-16T07:16:53.005ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
8942024-08-16T07:16:53.005ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/rot/cfpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b117ea17-b651-4719-9f36-3f02171d3b26", "content-length": "727", "date": "Fri, 16 Aug 2024 07:16:52 GMT"} })
8952024-08-16T07:16:53.005ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
8962024-08-16T07:16:53.005ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/rot/cfpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b07c3f5a-a713-44ac-99af-0b1113d0c8c6", "content-length": "729", "date": "Fri, 16 Aug 2024 07:16:52 GMT"} })
8972024-08-16T07:16:53.005ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
8982024-08-16T07:16:53.005ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/rot/cfpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "34919b10-1247-4fd7-9d98-75108dc14b50", "content-length": "728", "date": "Fri, 16 Aug 2024 07:16:52 GMT"} })
8992024-08-16T07:16:53.005ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
9002024-08-16T07:16:53.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
9012024-08-16T07:16:53.006ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9022024-08-16T07:16:53.008ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
9032024-08-16T07:16:53.008ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
9042024-08-16T07:16:53.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
9052024-08-16T07:16:53.009ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9062024-08-16T07:16:53.011ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
9072024-08-16T07:16:53.011ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
9082024-08-16T07:16:53.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
9092024-08-16T07:16:53.089ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
9102024-08-16T07:16:53.089ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
9112024-08-16T07:16:53.180ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/inventory", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a1fdba50-2532-4bfd-b76b-df9afa100377", "content-length": "2360", "date": "Fri, 16 Aug 2024 07:16:53 GMT"} })
9122024-08-16T07:16:53.182ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/omicron-zones
9132024-08-16T07:16:53.188ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/omicron-zones", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "dc4d125f-8a7c-4bb2-b1af-4adc1c3bae1f", "content-length": "10314", "date": "Fri, 16 Aug 2024 07:16:53 GMT"} })
9142024-08-16T07:16:53.189ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
9152024-08-16T07:16:53.189ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
9162024-08-16T07:16:53.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
9172024-08-16T07:16:53.190ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9182024-08-16T07:16:53.192ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
9192024-08-16T07:16:53.194ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
9202024-08-16T07:16:53.194ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
9212024-08-16T07:16:53.316ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = 5910cf20-b41a-492d-b1af-4b28539e68f6 file = nexus/db-queries/src/db/datastore/inventory.rs:893
9222024-08-16T07:16:53.318ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = 5910cf20-b41a-492d-b1af-4b28539e68f6 time_started = 2024-08-16 07:16:52.997856 UTC
9232024-08-16T07:16:53.318ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 359.172365ms iteration = 2 status = {"collection_id":"5910cf20-b41a-492d-b1af-4b28539e68f6","time_done":"2024-08-16 07:16:53.189742 UTC","time_started":"2024-08-16 07:16:52.997856 UTC"}
9242024-08-16T07:16:53.318ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 3 reason = Dependency
9252024-08-16T07:16:53.318ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
9262024-08-16T07:16:53.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
9272024-08-16T07:16:53.319ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9282024-08-16T07:16:53.320ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
9292024-08-16T07:16:53.320ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
9302024-08-16T07:16:53.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
9312024-08-16T07:16:53.322ZINFOnexus (BackgroundTasks): Physical Disk Adoption: Rack not yet initialized background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:79 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
9322024-08-16T07:16:53.322ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 3.994592ms iteration = 3 status = {"error":"rack not yet initialized: e1b0d583-7b20-4a4b-97f9-9f83300aeb7a"}
9332024-08-16T07:16:53.670ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = be57fda5-8a34-4fc7-b7e7-c276342563c2 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
9342024-08-16T07:16:53.671ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = be57fda5-8a34-4fc7-b7e7-c276342563c2 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
9352024-08-16T07:16:53.672ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2099 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = be57fda5-8a34-4fc7-b7e7-c276342563c2 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
9362024-08-16T07:16:53.711ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9372024-08-16T07:16:53.711ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9382024-08-16T07:16:53.713ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9392024-08-16T07:16:53.713ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9402024-08-16T07:16:53.714ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9412024-08-16T07:16:53.716ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: e1b0d583-7b20-4a4b-97f9-9f83300aeb7a, lookup_type: ById(e1b0d583-7b20-4a4b-97f9-9f83300aeb7a) } result = Ok(())
9422024-08-16T07:16:53.716ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: e1b0d583-7b20-4a4b-97f9-9f83300aeb7a, time_created: 2024-08-16T07:16:50.755850Z, time_modified: 2024-08-16T07:16:50.755850Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:726
9432024-08-16T07:16:54.691ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 65ceb91c-f580-4101-8d7d-7ff91f354c3e roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
9442024-08-16T07:16:54.691ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 65ceb91c-f580-4101-8d7d-7ff91f354c3e resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
9452024-08-16T07:16:54.692ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1812 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 65ceb91c-f580-4101-8d7d-7ff91f354c3e response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
9462024-08-16T07:16:55.711ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 6732486b-9531-4326-aa93-384bf5b94612 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
9472024-08-16T07:16:55.711ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 6732486b-9531-4326-aa93-384bf5b94612 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
9482024-08-16T07:16:55.713ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1651 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 6732486b-9531-4326-aa93-384bf5b94612 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
9492024-08-16T07:16:55.717ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9502024-08-16T07:16:55.717ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9512024-08-16T07:16:55.718ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9522024-08-16T07:16:55.719ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9532024-08-16T07:16:55.720ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9542024-08-16T07:16:55.722ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: e1b0d583-7b20-4a4b-97f9-9f83300aeb7a, lookup_type: ById(e1b0d583-7b20-4a4b-97f9-9f83300aeb7a) } result = Ok(())
9552024-08-16T07:16:55.722ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: e1b0d583-7b20-4a4b-97f9-9f83300aeb7a, time_created: 2024-08-16T07:16:50.755850Z, time_modified: 2024-08-16T07:16:50.755850Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:726
9562024-08-16T07:16:56.731ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 0ccec0de-5da7-4f6e-9f22-b0c3ff5df5e8 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
9572024-08-16T07:16:56.732ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 0ccec0de-5da7-4f6e-9f22-b0c3ff5df5e8 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
9582024-08-16T07:16:56.733ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1772 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 0ccec0de-5da7-4f6e-9f22-b0c3ff5df5e8 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
9592024-08-16T07:16:57.723ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9602024-08-16T07:16:57.724ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9612024-08-16T07:16:57.725ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9622024-08-16T07:16:57.725ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9632024-08-16T07:16:57.726ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9642024-08-16T07:16:57.728ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: e1b0d583-7b20-4a4b-97f9-9f83300aeb7a, lookup_type: ById(e1b0d583-7b20-4a4b-97f9-9f83300aeb7a) } result = Ok(())
9652024-08-16T07:16:57.728ZINFOnexus: Rack initialized file = nexus/src/app/rack.rs:723
9662024-08-16T07:16:57.728ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
9672024-08-16T07:16:57.728ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
9682024-08-16T07:16:57.730ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
9692024-08-16T07:16:57.730ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
9702024-08-16T07:16:57.731ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
9712024-08-16T07:16:57.731ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
9722024-08-16T07:16:57.732ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
9732024-08-16T07:16:57.732ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
9742024-08-16T07:16:57.733ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
9752024-08-16T07:16:57.733ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
9762024-08-16T07:16:57.734ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
9772024-08-16T07:16:57.734ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
9782024-08-16T07:16:57.735ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9792024-08-16T07:16:57.738ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
9802024-08-16T07:16:57.738ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
9812024-08-16T07:16:57.738ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
9822024-08-16T07:16:57.739ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
9832024-08-16T07:16:57.739ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
9842024-08-16T07:16:57.740ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
9852024-08-16T07:16:57.741ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
9862024-08-16T07:16:57.741ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9872024-08-16T07:16:57.744ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
9882024-08-16T07:16:57.744ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
9892024-08-16T07:16:57.744ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
9902024-08-16T07:16:57.746ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
9912024-08-16T07:16:57.746ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
9922024-08-16T07:16:57.747ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
9932024-08-16T07:16:57.747ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
9942024-08-16T07:16:57.748ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
9952024-08-16T07:16:57.748ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
9962024-08-16T07:16:57.749ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
9972024-08-16T07:16:57.749ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
9982024-08-16T07:16:57.749ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
9992024-08-16T07:16:57.750ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10002024-08-16T07:16:57.750ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10012024-08-16T07:16:57.751ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10022024-08-16T07:16:57.751ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10032024-08-16T07:16:57.752ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = cb888a7b-ed17-45e3-a0f1-df113d41fef9 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
10042024-08-16T07:16:57.753ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = cb888a7b-ed17-45e3-a0f1-df113d41fef9 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
10052024-08-16T07:16:57.754ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
10062024-08-16T07:16:57.754ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10072024-08-16T07:16:57.754ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10082024-08-16T07:16:57.755ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2111 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = cb888a7b-ed17-45e3-a0f1-df113d41fef9 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
10092024-08-16T07:16:57.755ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10102024-08-16T07:16:57.755ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10112024-08-16T07:16:57.757ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10122024-08-16T07:16:57.757ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10132024-08-16T07:16:57.758ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10142024-08-16T07:16:57.758ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10152024-08-16T07:16:57.759ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10162024-08-16T07:16:57.759ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10172024-08-16T07:16:57.760ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10182024-08-16T07:16:57.760ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10192024-08-16T07:16:57.761ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10202024-08-16T07:16:57.761ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10212024-08-16T07:16:57.762ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10222024-08-16T07:16:57.765ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
10232024-08-16T07:16:57.765ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10242024-08-16T07:16:57.765ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10252024-08-16T07:16:57.766ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10262024-08-16T07:16:57.766ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10272024-08-16T07:16:57.767ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10282024-08-16T07:16:57.767ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10292024-08-16T07:16:57.768ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10302024-08-16T07:16:57.771ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
10312024-08-16T07:16:57.771ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10322024-08-16T07:16:57.771ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10332024-08-16T07:16:57.774ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10342024-08-16T07:16:57.775ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10352024-08-16T07:16:57.776ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10362024-08-16T07:16:57.776ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10372024-08-16T07:16:57.777ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10382024-08-16T07:16:57.777ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10392024-08-16T07:16:57.778ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10402024-08-16T07:16:57.778ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10412024-08-16T07:16:57.779ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10422024-08-16T07:16:57.780ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10432024-08-16T07:16:57.780ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10442024-08-16T07:16:57.781ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10452024-08-16T07:16:57.781ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10462024-08-16T07:16:57.781ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10472024-08-16T07:16:57.782ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10482024-08-16T07:16:57.785ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
10492024-08-16T07:16:57.785ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10502024-08-16T07:16:57.785ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10512024-08-16T07:16:57.786ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10522024-08-16T07:16:57.786ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10532024-08-16T07:16:57.787ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10542024-08-16T07:16:57.787ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10552024-08-16T07:16:57.788ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10562024-08-16T07:16:57.791ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
10572024-08-16T07:16:57.791ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10582024-08-16T07:16:57.791ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10592024-08-16T07:16:57.794ZDEBGnexus (InternalApi): resolved names for firewall rules instance_interfaces = {} subnet_interfaces = {Name("external-dns"): [NetworkInterface { id: 0394c19d-c776-4986-aadf-3eb1689e7bef, kind: Service { id: dec19c15-1a2d-47ac-9b9e-9f424d3a3464 }, name: Name("external-dns-dec19c15-1a2d-47ac-9b9e-9f424d3a3464"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 149])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e9bad3ae-7417-4456-8d3e-34e4cbaa5de1, kind: Service { id: f9649eef-936b-4765-9810-da8662275db5 }, name: Name("external-dns-f9649eef-936b-4765-9810-da8662275db5"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 132])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("nexus"): [NetworkInterface { id: 036a4ce6-ea03-4027-b4fc-46b08e5aab80, kind: Service { id: 0d900881-9285-4dbf-910f-5e4676c8f133 }, name: Name("nexus-0d900881-9285-4dbf-910f-5e4676c8f133"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 188, 237])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7d720059-2cc6-4a99-8f2a-da62f41fe70c, kind: Service { id: 09eed6fc-f2ea-4ebd-a66c-d8895818c00c }, name: Name("nexus-09eed6fc-f2ea-4ebd-a66c-d8895818c00c"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 154])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: addeeb4f-a7d0-4d63-8259-b305b18b5ab1, kind: Service { id: 30e79e9e-c63b-4bdf-99e7-c71a02ecefc5 }, name: Name("nexus-30e79e9e-c63b-4bdf-99e7-c71a02ecefc5"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 179, 154])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
10602024-08-16T07:16:57.794ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10612024-08-16T07:16:57.794ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10622024-08-16T07:16:57.795ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10632024-08-16T07:16:57.797ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Fleet result = Ok(())
10642024-08-16T07:16:57.797ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10652024-08-16T07:16:57.797ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10662024-08-16T07:16:57.801ZDEBGnexus (InternalApi): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified.
10672024-08-16T07:16:57.803ZDEBGnexus (InternalApi): resolved firewall rules for sled agents sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 0394c19d-c776-4986-aadf-3eb1689e7bef, kind: Service { id: dec19c15-1a2d-47ac-9b9e-9f424d3a3464 }, name: Name("external-dns-dec19c15-1a2d-47ac-9b9e-9f424d3a3464"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 149])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e9bad3ae-7417-4456-8d3e-34e4cbaa5de1, kind: Service { id: f9649eef-936b-4765-9810-da8662275db5 }, name: Name("external-dns-f9649eef-936b-4765-9810-da8662275db5"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 132])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 036a4ce6-ea03-4027-b4fc-46b08e5aab80, kind: Service { id: 0d900881-9285-4dbf-910f-5e4676c8f133 }, name: Name("nexus-0d900881-9285-4dbf-910f-5e4676c8f133"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 188, 237])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7d720059-2cc6-4a99-8f2a-da62f41fe70c, kind: Service { id: 09eed6fc-f2ea-4ebd-a66c-d8895818c00c }, name: Name("nexus-09eed6fc-f2ea-4ebd-a66c-d8895818c00c"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 154])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: addeeb4f-a7d0-4d63-8259-b305b18b5ab1, kind: Service { id: 30e79e9e-c63b-4bdf-99e7-c71a02ecefc5 }, name: Name("nexus-30e79e9e-c63b-4bdf-99e7-c71a02ecefc5"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 179, 154])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
10682024-08-16T07:16:57.803ZDEBGnexus (InternalApi): resolved 2 rules for sleds
10692024-08-16T07:16:57.824ZDEBGnexus (InternalApi): resolved sleds for vpc oxide-services vpc_to_sled = [Sled { identity: SledIdentity { id: 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae, time_created: 2024-08-16T07:16:52.894284Z, time_modified: 2024-08-16T07:16:52.894284Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: e1b0d583-7b20-4a4b-97f9-9f83300aeb7a, is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
10702024-08-16T07:16:57.824ZDEBGnexus (InternalApi): sending firewall rules to sled agents
10712024-08-16T07:16:57.824ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10722024-08-16T07:16:57.824ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10732024-08-16T07:16:57.825ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10742024-08-16T07:16:57.826ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10752024-08-16T07:16:57.826ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10762024-08-16T07:16:57.829ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Sled { parent: Fleet, key: 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae, lookup_type: ById(03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae) } result = Ok(())
10772024-08-16T07:16:57.859ZDEBGnexus (InternalApi): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
10782024-08-16T07:16:57.860ZDEBGnexus (InternalApi): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", query: None, fragment: None }, status: 204, headers: {"x-request-id": "961a17ae-6fd4-4ec4-9e2d-3f4918a15828", "date": "Fri, 16 Aug 2024 07:16:57 GMT"} })
10792024-08-16T07:16:57.860ZINFOnexus (InternalApi): updated firewall rules on 1 sleds file = nexus/networking/src/firewall_rules.rs:496
10802024-08-16T07:16:57.860ZINFOnexus: plumbed initial IP allowlist file = nexus/src/app/allow_list.rs:161
10812024-08-16T07:16:58.774ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = e3c411ae-3078-42e0-a63a-e873cad2ed74 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
10822024-08-16T07:16:58.774ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = e3c411ae-3078-42e0-a63a-e873cad2ed74 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
10832024-08-16T07:16:58.776ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2366 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = e3c411ae-3078-42e0-a63a-e873cad2ed74 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
10842024-08-16T07:16:59.799ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 7815822f-dc1b-4df9-a097-23f16758ddb4 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
10852024-08-16T07:16:59.799ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 7815822f-dc1b-4df9-a097-23f16758ddb4 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
10862024-08-16T07:16:59.800ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1980 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 7815822f-dc1b-4df9-a097-23f16758ddb4 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
10872024-08-16T07:17:00.821ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 1d84e4c9-5282-4932-9311-dab6a60969ce roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
10882024-08-16T07:17:00.821ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 1d84e4c9-5282-4932-9311-dab6a60969ce resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
10892024-08-16T07:17:00.823ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1814 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 1d84e4c9-5282-4932-9311-dab6a60969ce response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
10902024-08-16T07:17:00.857ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 2 reason = Timeout
10912024-08-16T07:17:00.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10922024-08-16T07:17:00.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10932024-08-16T07:17:00.858ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10942024-08-16T07:17:00.860ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
10952024-08-16T07:17:00.860ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10962024-08-16T07:17:00.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10972024-08-16T07:17:00.862ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10982024-08-16T07:17:00.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10992024-08-16T07:17:00.863ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11002024-08-16T07:17:00.863ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 2 reason = Timeout
11012024-08-16T07:17:00.863ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
11022024-08-16T07:17:00.863ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
11032024-08-16T07:17:00.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
11042024-08-16T07:17:00.865ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
11052024-08-16T07:17:00.865ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11062024-08-16T07:17:00.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11072024-08-16T07:17:00.874ZINFOnexus (BackgroundTasks): found new target blueprint (first find) background_task = blueprint_loader file = nexus/src/app/background/tasks/blueprint_load.rs:87 target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
11082024-08-16T07:17:00.874ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 16.841609ms iteration = 2 status = {"status":"first target blueprint","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z","time_found":"2024-08-16T07:17:00.874047454Z"}
11092024-08-16T07:17:00.874ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 2 reason = Dependency
11102024-08-16T07:17:00.874ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 2 reason = Dependency
11112024-08-16T07:17:00.874ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:69 reason = blueprint disabled target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d
11122024-08-16T07:17:00.874ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 4.62\u{b5}s iteration = 2 status = {"error":"blueprint disabled","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d"}
11132024-08-16T07:17:00.876ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11142024-08-16T07:17:00.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11152024-08-16T07:17:00.876ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11162024-08-16T07:17:00.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11172024-08-16T07:17:00.877ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11182024-08-16T07:17:00.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11192024-08-16T07:17:00.877ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11202024-08-16T07:17:00.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11212024-08-16T07:17:00.877ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11222024-08-16T07:17:00.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11232024-08-16T07:17:00.878ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11242024-08-16T07:17:00.879ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
11252024-08-16T07:17:00.879ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11262024-08-16T07:17:00.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11272024-08-16T07:17:00.880ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11282024-08-16T07:17:00.881ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
11292024-08-16T07:17:00.881ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11302024-08-16T07:17:00.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11312024-08-16T07:17:00.881ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11322024-08-16T07:17:00.883ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
11332024-08-16T07:17:00.883ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11342024-08-16T07:17:00.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11352024-08-16T07:17:00.883ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11362024-08-16T07:17:00.884ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
11372024-08-16T07:17:00.884ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11382024-08-16T07:17:00.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11392024-08-16T07:17:00.884ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11402024-08-16T07:17:00.886ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
11412024-08-16T07:17:00.886ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11422024-08-16T07:17:00.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11432024-08-16T07:17:00.888ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
11442024-08-16T07:17:00.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
11452024-08-16T07:17:00.913ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
11462024-08-16T07:17:00.913ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 49.634597ms iteration = 2 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
11472024-08-16T07:17:00.919ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::6]:32222/node/id
11482024-08-16T07:17:00.950ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::3]:32222/node/id
11492024-08-16T07:17:00.982ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::5]:32222/node/id
11502024-08-16T07:17:01.014ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::7]:32222/node/id
11512024-08-16T07:17:01.046ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::4]:32222/node/id
11522024-08-16T07:17:01.843ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 76140cb6-637a-4de5-91be-c848fea64026 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
11532024-08-16T07:17:01.843ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 76140cb6-637a-4de5-91be-c848fea64026 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
11542024-08-16T07:17:01.844ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1889 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 76140cb6-637a-4de5-91be-c848fea64026 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
11552024-08-16T07:17:01.998ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::6)), port: Some(32222), path: "/node/id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "18ad2354-3b95-4a25-a3ae-4170cbd93f06", "content-length": "64", "date": "Fri, 16 Aug 2024 07:17:01 GMT"} })
11562024-08-16T07:17:01.998ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11572024-08-16T07:17:01.998ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11582024-08-16T07:17:02.000ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11592024-08-16T07:17:02.002ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
11602024-08-16T07:17:02.002ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11612024-08-16T07:17:02.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11622024-08-16T07:17:02.503ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::4)), port: Some(32222), path: "/node/id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f01d34ca-9217-430d-b11e-ea4e2101c8fd", "content-length": "64", "date": "Fri, 16 Aug 2024 07:17:02 GMT"} })
11632024-08-16T07:17:02.503ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11642024-08-16T07:17:02.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11652024-08-16T07:17:02.505ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11662024-08-16T07:17:02.506ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
11672024-08-16T07:17:02.506ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11682024-08-16T07:17:02.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11692024-08-16T07:17:02.535ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::3)), port: Some(32222), path: "/node/id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ad9fdc56-5fb2-454b-aa23-4f04e9705215", "content-length": "64", "date": "Fri, 16 Aug 2024 07:17:02 GMT"} })
11702024-08-16T07:17:02.535ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11712024-08-16T07:17:02.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11722024-08-16T07:17:02.536ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11732024-08-16T07:17:02.537ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
11742024-08-16T07:17:02.537ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11752024-08-16T07:17:02.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11762024-08-16T07:17:02.581ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::5)), port: Some(32222), path: "/node/id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "370ae754-3175-4f24-942e-d977347dfcc1", "content-length": "64", "date": "Fri, 16 Aug 2024 07:17:02 GMT"} })
11772024-08-16T07:17:02.581ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11782024-08-16T07:17:02.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11792024-08-16T07:17:02.583ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11802024-08-16T07:17:02.584ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
11812024-08-16T07:17:02.584ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11822024-08-16T07:17:02.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11832024-08-16T07:17:02.671ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::7)), port: Some(32222), path: "/node/id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "4781b258-071b-49d0-a13d-d1f1166d858e", "content-length": "64", "date": "Fri, 16 Aug 2024 07:17:02 GMT"} })
11842024-08-16T07:17:02.671ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11852024-08-16T07:17:02.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11862024-08-16T07:17:02.672ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11872024-08-16T07:17:02.673ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
11882024-08-16T07:17:02.673ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11892024-08-16T07:17:02.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11902024-08-16T07:17:02.679ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 1.805060577s iteration = 2 status = {"nsuccess":5}
11912024-08-16T07:17:02.864ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 0bfc62d5-5241-40aa-88ac-9ed0c2da13f3 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
11922024-08-16T07:17:02.864ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 0bfc62d5-5241-40aa-88ac-9ed0c2da13f3 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
11932024-08-16T07:17:02.865ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1359 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 0bfc62d5-5241-40aa-88ac-9ed0c2da13f3 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
11942024-08-16T07:17:03.884ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 9c7d7f84-15c8-4a00-90c8-6dce2d85c4c9 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
11952024-08-16T07:17:03.884ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 9c7d7f84-15c8-4a00-90c8-6dce2d85c4c9 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
11962024-08-16T07:17:03.886ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1561 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 9c7d7f84-15c8-4a00-90c8-6dce2d85c4c9 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
11972024-08-16T07:17:04.905ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = d20ebcf8-5e64-4994-aa0c-285544f700ff roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
11982024-08-16T07:17:04.905ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = d20ebcf8-5e64-4994-aa0c-285544f700ff resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
11992024-08-16T07:17:04.907ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2066 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = d20ebcf8-5e64-4994-aa0c-285544f700ff response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
12002024-08-16T07:17:05.925ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 067058d0-4494-45e6-8a38-de47ae9694d8 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
12012024-08-16T07:17:05.926ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 067058d0-4494-45e6-8a38-de47ae9694d8 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
12022024-08-16T07:17:05.927ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1810 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 067058d0-4494-45e6-8a38-de47ae9694d8 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
12032024-08-16T07:17:06.945ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 8580ab41-7c38-4d02-8df9-68f63ab42487 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
12042024-08-16T07:17:06.946ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 8580ab41-7c38-4d02-8df9-68f63ab42487 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
12052024-08-16T07:17:06.947ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1536 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 8580ab41-7c38-4d02-8df9-68f63ab42487 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
12062024-08-16T07:17:07.966ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 40c2da3c-0695-43c4-8e4b-82791edbdbcf roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
12072024-08-16T07:17:07.966ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 40c2da3c-0695-43c4-8e4b-82791edbdbcf resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
12082024-08-16T07:17:07.968ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2432 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 40c2da3c-0695-43c4-8e4b-82791edbdbcf response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
12092024-08-16T07:17:08.987ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = ceeb8a89-76c1-4b8e-9856-e73d95ad030f roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
12102024-08-16T07:17:08.987ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = ceeb8a89-76c1-4b8e-9856-e73d95ad030f resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
12112024-08-16T07:17:08.988ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1561 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = ceeb8a89-76c1-4b8e-9856-e73d95ad030f response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
12122024-08-16T07:17:10.007ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 284a3d29-9c01-4913-8b6f-abc2f48cb0d4 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
12132024-08-16T07:17:10.008ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 284a3d29-9c01-4913-8b6f-abc2f48cb0d4 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
12142024-08-16T07:17:10.009ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1450 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 284a3d29-9c01-4913-8b6f-abc2f48cb0d4 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
12152024-08-16T07:17:10.857ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 3 reason = Timeout
12162024-08-16T07:17:10.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12172024-08-16T07:17:10.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12182024-08-16T07:17:10.858ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12192024-08-16T07:17:10.861ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
12202024-08-16T07:17:10.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12212024-08-16T07:17:10.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12222024-08-16T07:17:10.862ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12232024-08-16T07:17:10.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12242024-08-16T07:17:10.863ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 3 reason = Timeout
12252024-08-16T07:17:10.863ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
12262024-08-16T07:17:10.863ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12272024-08-16T07:17:10.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12282024-08-16T07:17:10.863ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12292024-08-16T07:17:10.866ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
12302024-08-16T07:17:10.866ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12312024-08-16T07:17:10.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12322024-08-16T07:17:10.872ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
12332024-08-16T07:17:10.872ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 15.122169ms iteration = 3 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
12342024-08-16T07:17:10.890ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12352024-08-16T07:17:10.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12362024-08-16T07:17:10.892ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
12372024-08-16T07:17:10.892ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.088811ms iteration = 3 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
12382024-08-16T07:17:11.028ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 12bc86e5-98bb-4d76-a566-fe25e178fc25 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
12392024-08-16T07:17:11.029ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 12bc86e5-98bb-4d76-a566-fe25e178fc25 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
12402024-08-16T07:17:11.030ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1753 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 12bc86e5-98bb-4d76-a566-fe25e178fc25 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
12412024-08-16T07:17:12.050ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = db9af50f-fb8f-4c85-99ff-ab6b7f289043 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
12422024-08-16T07:17:12.050ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = db9af50f-fb8f-4c85-99ff-ab6b7f289043 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
12432024-08-16T07:17:12.051ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2677 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = db9af50f-fb8f-4c85-99ff-ab6b7f289043 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
12442024-08-16T07:17:13.070ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = d92a48e9-db05-494f-a7f2-b9f1e3ae9e54 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
12452024-08-16T07:17:13.070ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = d92a48e9-db05-494f-a7f2-b9f1e3ae9e54 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
12462024-08-16T07:17:13.072ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1736 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = d92a48e9-db05-494f-a7f2-b9f1e3ae9e54 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
12472024-08-16T07:17:14.091ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 0342669a-b984-4d81-819e-381bf194514e roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
12482024-08-16T07:17:14.091ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 0342669a-b984-4d81-819e-381bf194514e resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
12492024-08-16T07:17:14.092ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1560 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 0342669a-b984-4d81-819e-381bf194514e response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
12502024-08-16T07:17:15.112ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 69fadf36-4aa5-43d8-8d7f-50b8bc838864 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
12512024-08-16T07:17:15.112ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 69fadf36-4aa5-43d8-8d7f-50b8bc838864 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
12522024-08-16T07:17:15.114ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1817 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 69fadf36-4aa5-43d8-8d7f-50b8bc838864 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
12532024-08-16T07:17:16.133ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = bb55f974-e6a4-4bf3-afec-2961d853a08b roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
12542024-08-16T07:17:16.133ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = bb55f974-e6a4-4bf3-afec-2961d853a08b resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
12552024-08-16T07:17:16.134ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1596 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = bb55f974-e6a4-4bf3-afec-2961d853a08b response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
12562024-08-16T07:17:17.154ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = fa1e5bb2-3025-471a-a225-918a12e8e16c roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
12572024-08-16T07:17:17.154ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = fa1e5bb2-3025-471a-a225-918a12e8e16c resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
12582024-08-16T07:17:17.155ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2058 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = fa1e5bb2-3025-471a-a225-918a12e8e16c response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
12592024-08-16T07:17:18.175ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = eb1e30f3-ab18-4cf4-9e5f-a39e19660b7f roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
12602024-08-16T07:17:18.175ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = eb1e30f3-ab18-4cf4-9e5f-a39e19660b7f resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
12612024-08-16T07:17:18.176ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2046 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = eb1e30f3-ab18-4cf4-9e5f-a39e19660b7f response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
12622024-08-16T07:17:19.196ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = b39d2622-a8a0-4ffb-848c-39377412f855 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
12632024-08-16T07:17:19.196ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = b39d2622-a8a0-4ffb-848c-39377412f855 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
12642024-08-16T07:17:19.198ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1757 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = b39d2622-a8a0-4ffb-848c-39377412f855 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
12652024-08-16T07:17:20.218ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = cc7d4c25-f6e4-4799-b376-2d7b90e4eab2 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
12662024-08-16T07:17:20.218ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = cc7d4c25-f6e4-4799-b376-2d7b90e4eab2 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
12672024-08-16T07:17:20.219ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2580 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = cc7d4c25-f6e4-4799-b376-2d7b90e4eab2 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
12682024-08-16T07:17:20.649ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64556 req_id = 8cd58389-289b-4e6e-827b-9b07d3254876 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
12692024-08-16T07:17:20.650ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64556 req_id = 8cd58389-289b-4e6e-827b-9b07d3254876 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
12702024-08-16T07:17:20.653ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 4019 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64556 req_id = 8cd58389-289b-4e6e-827b-9b07d3254876 response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
12712024-08-16T07:17:20.857ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 2 reason = Timeout
12722024-08-16T07:17:20.857ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 2 reason = Timeout
12732024-08-16T07:17:20.857ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 4 reason = Timeout
12742024-08-16T07:17:20.857ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
12752024-08-16T07:17:20.857ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
12762024-08-16T07:17:20.857ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 2 reason = Timeout
12772024-08-16T07:17:20.857ZWARNnexus (BackgroundTasks): phantom disk task started background_task = phantom_disks file = nexus/src/app/background/tasks/phantom_disks.rs:46
12782024-08-16T07:17:20.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12792024-08-16T07:17:20.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
12802024-08-16T07:17:20.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12812024-08-16T07:17:20.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
12822024-08-16T07:17:20.858ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 4 reason = Timeout
12832024-08-16T07:17:20.858ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
12842024-08-16T07:17:20.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
12852024-08-16T07:17:20.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12862024-08-16T07:17:20.859ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1104, tv_nsec: 235145178 } })
12872024-08-16T07:17:20.859ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12882024-08-16T07:17:20.859ZWARNnexus (BackgroundTasks): phantom disk task done background_task = phantom_disks file = nexus/src/app/background/tasks/phantom_disks.rs:93
12892024-08-16T07:17:20.859ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.380755ms iteration = 2 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
12902024-08-16T07:17:20.860ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
12912024-08-16T07:17:20.860ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1104, tv_nsec: 236023568 } })
12922024-08-16T07:17:20.861ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
12932024-08-16T07:17:20.862ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
12942024-08-16T07:17:20.862ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12952024-08-16T07:17:20.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12962024-08-16T07:17:20.862ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
12972024-08-16T07:17:20.862ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
12982024-08-16T07:17:20.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
12992024-08-16T07:17:20.863ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13002024-08-16T07:17:20.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13012024-08-16T07:17:20.863ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 4 reason = Timeout
13022024-08-16T07:17:20.863ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
13032024-08-16T07:17:20.863ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13042024-08-16T07:17:20.863ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 2 reason = Timeout
13052024-08-16T07:17:20.863ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 2 reason = Timeout
13062024-08-16T07:17:20.863ZINFOnexus (BackgroundTasks): region snapshot replacement start task started background_task = region_snapshot_replacement_start file = nexus/src/app/background/tasks/region_snapshot_replacement_start.rs:236
13072024-08-16T07:17:20.863ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
13082024-08-16T07:17:20.863ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
13092024-08-16T07:17:20.863ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 2 reason = Timeout
13102024-08-16T07:17:20.863ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13112024-08-16T07:17:20.863ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 2 reason = Timeout
13122024-08-16T07:17:20.863ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 2 reason = Timeout
13132024-08-16T07:17:20.863ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13142024-08-16T07:17:20.863ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 2 reason = Timeout
13152024-08-16T07:17:20.863ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13162024-08-16T07:17:20.863ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
13172024-08-16T07:17:20.863ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 2 reason = Timeout
13182024-08-16T07:17:20.863ZINFOnexus (BackgroundTasks): region snapshot replacement garbage collect task started background_task = region_snapshot_replacement_garbage_collection file = nexus/src/app/background/tasks/region_snapshot_replacement_garbage_collect.rs:133
13192024-08-16T07:17:20.863ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
13202024-08-16T07:17:20.863ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 2 reason = Timeout
13212024-08-16T07:17:20.863ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
13222024-08-16T07:17:20.863ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 2 reason = Timeout
13232024-08-16T07:17:20.863ZWARNnexus (BackgroundTasks): region replacement task started background_task = region_replacement file = nexus/src/app/background/tasks/region_replacement.rs:64
13242024-08-16T07:17:20.863ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
13252024-08-16T07:17:20.863ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
13262024-08-16T07:17:20.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13272024-08-16T07:17:20.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
13282024-08-16T07:17:20.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
13292024-08-16T07:17:20.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
13302024-08-16T07:17:20.863ZWARNnexus (BackgroundTasks): physical disk adoption task started background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:100
13312024-08-16T07:17:20.863ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
13322024-08-16T07:17:20.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
13332024-08-16T07:17:20.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13342024-08-16T07:17:20.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
13352024-08-16T07:17:20.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
13362024-08-16T07:17:20.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
13372024-08-16T07:17:20.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13382024-08-16T07:17:20.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
13392024-08-16T07:17:20.864ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13402024-08-16T07:17:20.864ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13412024-08-16T07:17:20.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13422024-08-16T07:17:20.865ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13432024-08-16T07:17:20.865ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13442024-08-16T07:17:20.866ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13452024-08-16T07:17:20.866ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13462024-08-16T07:17:20.866ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
13472024-08-16T07:17:20.866ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.295956ms iteration = 4 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
13482024-08-16T07:17:20.867ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
13492024-08-16T07:17:20.867ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13502024-08-16T07:17:20.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13512024-08-16T07:17:20.868ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
13522024-08-16T07:17:20.868ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13532024-08-16T07:17:20.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13542024-08-16T07:17:20.869ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
13552024-08-16T07:17:20.869ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13562024-08-16T07:17:20.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13572024-08-16T07:17:20.869ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
13582024-08-16T07:17:20.869ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
13592024-08-16T07:17:20.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
13602024-08-16T07:17:20.869ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
13612024-08-16T07:17:20.869ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13622024-08-16T07:17:20.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
13632024-08-16T07:17:20.870ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13642024-08-16T07:17:20.871ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13652024-08-16T07:17:20.871ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1104, tv_nsec: 246813287 } })
13662024-08-16T07:17:20.872ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
13672024-08-16T07:17:20.874ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
13682024-08-16T07:17:20.874ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13692024-08-16T07:17:20.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13702024-08-16T07:17:20.874ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
13712024-08-16T07:17:20.874ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.168916ms iteration = 4 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
13722024-08-16T07:17:20.874ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
13732024-08-16T07:17:20.874ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
13742024-08-16T07:17:20.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
13752024-08-16T07:17:20.875ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13762024-08-16T07:17:20.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
13772024-08-16T07:17:20.879ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
13782024-08-16T07:17:20.879ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 15.60033ms iteration = 2 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
13792024-08-16T07:17:20.900ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
13802024-08-16T07:17:20.900ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
13812024-08-16T07:17:20.900ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
13822024-08-16T07:17:20.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
13832024-08-16T07:17:20.902ZINFOnexus (BackgroundTasks): region snapshot replacement garbage collect task done background_task = region_snapshot_replacement_garbage_collection file = nexus/src/app/background/tasks/region_snapshot_replacement_garbage_collect.rs:147
13842024-08-16T07:17:20.902ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 38.626792ms iteration = 2 status = {"errors":[],"garbage_collect_requested":[]}
13852024-08-16T07:17:20.905ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
13862024-08-16T07:17:20.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
13872024-08-16T07:17:20.906ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
13882024-08-16T07:17:20.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
13892024-08-16T07:17:20.910ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13902024-08-16T07:17:20.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
13912024-08-16T07:17:20.912ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13922024-08-16T07:17:20.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
13932024-08-16T07:17:20.914ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13942024-08-16T07:17:20.917ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae, lookup_type: ById(03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae) } result = Ok(())
13952024-08-16T07:17:20.917ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13962024-08-16T07:17:20.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
13972024-08-16T07:17:20.919ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13982024-08-16T07:17:20.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
13992024-08-16T07:17:20.932ZINFOnexus (BackgroundTasks): region snapshot replacement start task done background_task = region_snapshot_replacement_start file = nexus/src/app/background/tasks/region_snapshot_replacement_start.rs:252
14002024-08-16T07:17:20.932ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 68.841399ms iteration = 2 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
14012024-08-16T07:17:20.933ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14022024-08-16T07:17:20.933ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14032024-08-16T07:17:20.943ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14042024-08-16T07:17:20.943ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14052024-08-16T07:17:20.945ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
14062024-08-16T07:17:20.946ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
14072024-08-16T07:17:20.946ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 82.404223ms iteration = 2 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
14082024-08-16T07:17:20.950ZWARNnexus (BackgroundTasks): region replacement task done background_task = region_replacement file = nexus/src/app/background/tasks/region_replacement.rs:185
14092024-08-16T07:17:20.950ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 86.548489ms iteration = 2 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
14102024-08-16T07:17:20.953ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14112024-08-16T07:17:20.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14122024-08-16T07:17:20.957ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14132024-08-16T07:17:20.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14142024-08-16T07:17:20.963ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14152024-08-16T07:17:20.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14162024-08-16T07:17:20.963ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
14172024-08-16T07:17:20.963ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
14182024-08-16T07:17:20.963ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "bbf39206-3d51-4433-b92c-e18962e389c0", "content-length": "26", "date": "Fri, 16 Aug 2024 07:17:20 GMT"} })
14192024-08-16T07:17:20.963ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
14202024-08-16T07:17:20.964ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14212024-08-16T07:17:20.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
14222024-08-16T07:17:20.965ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
14232024-08-16T07:17:20.968ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1104, tv_nsec: 343640603 } })
14242024-08-16T07:17:20.968ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = service_zone_nat_tracker file = nexus/src/app/mod.rs:1050
14252024-08-16T07:17:20.972ZWARNnexus (BackgroundTasks): physical disk adoption task done background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:174
14262024-08-16T07:17:20.972ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 113.85704ms iteration = 4 status = {"physical_disks_added":0}
14272024-08-16T07:17:20.996ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14282024-08-16T07:17:20.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
14292024-08-16T07:17:20.997ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14302024-08-16T07:17:20.999ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
14312024-08-16T07:17:20.999ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14322024-08-16T07:17:20.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
14332024-08-16T07:17:21.000ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14342024-08-16T07:17:21.002ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
14352024-08-16T07:17:21.002ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14362024-08-16T07:17:21.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
14372024-08-16T07:17:21.126ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
14382024-08-16T07:17:21.126ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "50f1fd47-0762-4d96-8d68-6e7537d0dcd4", "content-length": "1", "date": "Fri, 16 Aug 2024 07:17:20 GMT"} })
14392024-08-16T07:17:21.128ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
14402024-08-16T07:17:21.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
14412024-08-16T07:17:21.129ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 272.541154ms iteration = 2 status = null
14422024-08-16T07:17:21.175ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = service_zone_nat_tracker file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
14432024-08-16T07:17:21.175ZDEBGnexus (MgsClient): client request background_task = service_zone_nat_tracker body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
14442024-08-16T07:17:21.175ZDEBGnexus (MgsClient): client response background_task = service_zone_nat_tracker result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "180a0432-2920-4a9a-a14b-bfff8a315ac4", "content-length": "26", "date": "Fri, 16 Aug 2024 07:17:20 GMT"} })
14452024-08-16T07:17:21.175ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = service_zone_nat_tracker file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
14462024-08-16T07:17:21.177ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = service_zone_nat_tracker file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
14472024-08-16T07:17:21.192ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
14482024-08-16T07:17:21.192ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
14492024-08-16T07:17:21.193ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "8474294a-ce57-4904-9983-a718b6d17a72", "content-length": "26", "date": "Fri, 16 Aug 2024 07:17:20 GMT"} })
14502024-08-16T07:17:21.193ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
14512024-08-16T07:17:21.195ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
14522024-08-16T07:17:21.219ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a zone_address = fd00:1122:3344:101::2
14532024-08-16T07:17:21.219ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
14542024-08-16T07:17:21.220ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "68c58af3-4ba0-44c2-810c-fd8e43e3739f", "content-length": "26", "date": "Fri, 16 Aug 2024 07:17:21 GMT"} })
14552024-08-16T07:17:21.220ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
14562024-08-16T07:17:21.221ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
14572024-08-16T07:17:21.228ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
14582024-08-16T07:17:21.229ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "37ab9ad3-764e-4c87-8714-3266b052fb39", "content-length": "372", "date": "Fri, 16 Aug 2024 07:17:21 GMT"} })
14592024-08-16T07:17:21.229ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14602024-08-16T07:17:21.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14612024-08-16T07:17:21.231ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14622024-08-16T07:17:21.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14632024-08-16T07:17:21.234ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14642024-08-16T07:17:21.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14652024-08-16T07:17:21.236ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
14662024-08-16T07:17:21.236ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "6bc0b4a5-1373-4a9a-825c-43fd2d77a168", "date": "Fri, 16 Aug 2024 07:17:21 GMT"} })
14672024-08-16T07:17:21.238ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 374.97386ms iteration = 2 status = {}
14682024-08-16T07:17:21.241ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 041f455a-02e4-4bd3-afd5-3769e5d9c89a roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
14692024-08-16T07:17:21.241ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 041f455a-02e4-4bd3-afd5-3769e5d9c89a resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
14702024-08-16T07:17:21.242ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1374 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 041f455a-02e4-4bd3-afd5-3769e5d9c89a response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
14712024-08-16T07:17:21.260ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
14722024-08-16T07:17:21.260ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "38adc42a-867d-4965-af63-cebc00de23a2", "content-length": "691", "date": "Fri, 16 Aug 2024 07:17:21 GMT"} })
14732024-08-16T07:17:21.260ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
14742024-08-16T07:17:21.260ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
14752024-08-16T07:17:21.260ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
14762024-08-16T07:17:21.262ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 398.922783ms iteration = 2 status = {}
14772024-08-16T07:17:21.377ZDEBGnexus (DpdClient): client request background_task = service_zone_nat_tracker body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
14782024-08-16T07:17:21.378ZDEBGnexus (DpdClient): client response background_task = service_zone_nat_tracker result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/trigger", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6fd9ab77-ea7e-47c1-ad22-691f16107217", "content-length": "4", "date": "Fri, 16 Aug 2024 07:17:20 GMT"} })
14792024-08-16T07:17:21.379ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 516.293854ms iteration = 2 status = 6
14802024-08-16T07:17:21.394ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 536.872219ms iteration = 2 status = {}
14812024-08-16T07:17:21.442ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14822024-08-16T07:17:21.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14832024-08-16T07:17:21.444ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:146 port = SwitchPort { id: f13c0939-2c9d-4a0d-b006-5f3de89cc4fc, rack_id: e1b0d583-7b20-4a4b-97f9-9f83300aeb7a, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(4de7fcf8-2b1f-4b0e-ba6f-584e8a34addb) } rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0
14842024-08-16T07:17:21.444ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14852024-08-16T07:17:21.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14862024-08-16T07:17:21.464ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
14872024-08-16T07:17:21.466ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "5d1e46af-0adf-4dcd-b10e-ebddfaae692b", "content-length": "121", "date": "Fri, 16 Aug 2024 07:17:21 GMT"} })
14882024-08-16T07:17:21.468ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1663 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
14892024-08-16T07:17:21.468ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1690 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 4de7fcf8-2b1f-4b0e-ba6f-584e8a34addb
14902024-08-16T07:17:21.470ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None)}}
14912024-08-16T07:17:21.470ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None)}}
14922024-08-16T07:17:21.470ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {}
14932024-08-16T07:17:21.470ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {}
14942024-08-16T07:17:21.470ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
14952024-08-16T07:17:21.470ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14962024-08-16T07:17:21.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14972024-08-16T07:17:21.472ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
14982024-08-16T07:17:21.473ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e373fcf6-f90c-47ae-9650-c9c1669ca36f", "content-length": "2", "date": "Fri, 16 Aug 2024 07:17:21 GMT"} })
14992024-08-16T07:17:21.473ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
15002024-08-16T07:17:21.474ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "2484949d-2984-4feb-b02d-0e77450d2100", "content-length": "52", "date": "Fri, 16 Aug 2024 07:17:21 GMT"} })
15012024-08-16T07:17:21.474ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0
15022024-08-16T07:17:21.474ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
15032024-08-16T07:17:21.580ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "eff2bf3a-5a60-4a1b-b2d4-5f19f226e461", "date": "Fri, 16 Aug 2024 07:17:21 GMT"} })
15042024-08-16T07:17:21.580ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch = Switch0
15052024-08-16T07:17:21.580ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
15062024-08-16T07:17:21.583ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f3c4f1fb-15bd-402c-8a95-bbcf1e20bda2", "content-length": "494", "date": "Fri, 16 Aug 2024 07:17:21 GMT"} })
15072024-08-16T07:17:21.584ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15082024-08-16T07:17:21.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15092024-08-16T07:17:21.594ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15102024-08-16T07:17:21.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15112024-08-16T07:17:21.596ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15122024-08-16T07:17:21.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15132024-08-16T07:17:21.598ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15142024-08-16T07:17:21.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15152024-08-16T07:17:21.599ZWARNnexus (BackgroundTasks): no bootstore config found in db background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1194 key = network_key rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
15162024-08-16T07:17:21.599ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15172024-08-16T07:17:21.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15182024-08-16T07:17:21.603ZINFOnexus (BackgroundTasks): updating bootstore config background_task = switch_port_config_manager config = EarlyNetworkConfig { body: EarlyNetworkConfigBody { ntp_servers: ["0.pool.ntp.org"], rack_network_config: Some(RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [PortConfigV2 { addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], autoneg: false, bgp_peers: [], port: "qsfp0", routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.2.100, vlan_id: None }], switch: Switch0, uplink_port_fec: None, uplink_port_speed: Speed40G }], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 } }) }, generation: 2, schema_version: 2 } file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1251 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
15192024-08-16T07:17:21.603ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = PUT rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
15202024-08-16T07:17:21.607ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "f0e86cb6-1f1e-48af-b3f7-5c33d470c397", "date": "Fri, 16 Aug 2024 07:17:21 GMT"} })
15212024-08-16T07:17:21.607ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15222024-08-16T07:17:21.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15232024-08-16T07:17:21.615ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 751.669999ms iteration = 2 status = {}
15242024-08-16T07:17:21.653ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64556 req_id = 1a3e1c32-696c-4af6-be16-568d427f9144 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
15252024-08-16T07:17:21.654ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64556 req_id = 1a3e1c32-696c-4af6-be16-568d427f9144 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
15262024-08-16T07:17:21.658ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 4542 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64556 req_id = 1a3e1c32-696c-4af6-be16-568d427f9144 response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
15272024-08-16T07:17:21.661ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64556 req_id = 8643175b-d396-45b5-be19-8d79819220f1 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
15282024-08-16T07:17:21.661ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64556 req_id = 8643175b-d396-45b5-be19-8d79819220f1 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
15292024-08-16T07:17:21.663ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2062 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64556 req_id = 8643175b-d396-45b5-be19-8d79819220f1 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
15302024-08-16T07:17:22.263ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 056e995c-e671-4930-954f-80706c6e3e58 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
15312024-08-16T07:17:22.263ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 056e995c-e671-4930-954f-80706c6e3e58 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
15322024-08-16T07:17:22.264ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2417 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 056e995c-e671-4930-954f-80706c6e3e58 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
15332024-08-16T07:17:23.281ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = e84d8f46-cfac-4327-abff-9ad3a7cb0f1a roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
15342024-08-16T07:17:23.282ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = e84d8f46-cfac-4327-abff-9ad3a7cb0f1a resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
15352024-08-16T07:17:23.283ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1645 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = e84d8f46-cfac-4327-abff-9ad3a7cb0f1a response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
15362024-08-16T07:17:24.302ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = c5ee5661-8280-4654-8cd5-1214915dd4ba roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
15372024-08-16T07:17:24.302ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = c5ee5661-8280-4654-8cd5-1214915dd4ba resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
15382024-08-16T07:17:24.304ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1980 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = c5ee5661-8280-4654-8cd5-1214915dd4ba response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
15392024-08-16T07:17:25.323ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 2b9ffa7f-778c-4efb-8966-efacf242edcf roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
15402024-08-16T07:17:25.324ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 2b9ffa7f-778c-4efb-8966-efacf242edcf resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
15412024-08-16T07:17:25.325ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1918 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 2b9ffa7f-778c-4efb-8966-efacf242edcf response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
15422024-08-16T07:17:26.344ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = dbb5b01a-71d5-4686-bd3c-20e6e5fe8e0d roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
15432024-08-16T07:17:26.344ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = dbb5b01a-71d5-4686-bd3c-20e6e5fe8e0d resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
15442024-08-16T07:17:26.346ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1726 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = dbb5b01a-71d5-4686-bd3c-20e6e5fe8e0d response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
15452024-08-16T07:17:27.366ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = e7363cb1-c1e0-483d-bd2a-d54c86c4c356 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
15462024-08-16T07:17:27.366ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = e7363cb1-c1e0-483d-bd2a-d54c86c4c356 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
15472024-08-16T07:17:27.368ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1801 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = e7363cb1-c1e0-483d-bd2a-d54c86c4c356 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
15482024-08-16T07:17:28.386ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 0b0e4e45-c4ce-4542-896b-fa3a8f6b7c44 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
15492024-08-16T07:17:28.387ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 0b0e4e45-c4ce-4542-896b-fa3a8f6b7c44 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
15502024-08-16T07:17:28.388ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2514 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 0b0e4e45-c4ce-4542-896b-fa3a8f6b7c44 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
15512024-08-16T07:17:29.407ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = ba69ee00-a988-4913-912d-e5098addd3a7 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
15522024-08-16T07:17:29.408ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = ba69ee00-a988-4913-912d-e5098addd3a7 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
15532024-08-16T07:17:29.409ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1697 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = ba69ee00-a988-4913-912d-e5098addd3a7 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
15542024-08-16T07:17:30.428ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 2b5c39bf-0892-4b88-97f3-17fef58c944c roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
15552024-08-16T07:17:30.428ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 2b5c39bf-0892-4b88-97f3-17fef58c944c resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
15562024-08-16T07:17:30.430ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2137 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 2b5c39bf-0892-4b88-97f3-17fef58c944c response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
15572024-08-16T07:17:30.857ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 5 reason = Timeout
15582024-08-16T07:17:30.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15592024-08-16T07:17:30.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15602024-08-16T07:17:30.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15612024-08-16T07:17:30.861ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
15622024-08-16T07:17:30.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15632024-08-16T07:17:30.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15642024-08-16T07:17:30.862ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15652024-08-16T07:17:30.862ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 5 reason = Timeout
15662024-08-16T07:17:30.862ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
15672024-08-16T07:17:30.862ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15682024-08-16T07:17:30.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15692024-08-16T07:17:30.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15702024-08-16T07:17:30.864ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15712024-08-16T07:17:30.864ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15722024-08-16T07:17:30.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15732024-08-16T07:17:30.866ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
15742024-08-16T07:17:30.866ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.718876ms iteration = 5 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
15752024-08-16T07:17:30.866ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
15762024-08-16T07:17:30.866ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15772024-08-16T07:17:30.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15782024-08-16T07:17:30.870ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
15792024-08-16T07:17:30.870ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 13.41816ms iteration = 5 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
15802024-08-16T07:17:31.448ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 1774c2fc-e50e-4069-8168-c97b960f2f2d roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
15812024-08-16T07:17:31.448ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 1774c2fc-e50e-4069-8168-c97b960f2f2d resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
15822024-08-16T07:17:31.450ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1607 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 1774c2fc-e50e-4069-8168-c97b960f2f2d response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
15832024-08-16T07:17:32.468ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = bb1bb3df-e27d-498c-91d7-10449d28c4b2 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
15842024-08-16T07:17:32.468ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = bb1bb3df-e27d-498c-91d7-10449d28c4b2 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
15852024-08-16T07:17:32.469ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1781 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = bb1bb3df-e27d-498c-91d7-10449d28c4b2 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
15862024-08-16T07:17:33.489ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 049b6b8d-62e1-417f-afbc-1dec658a8bc4 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
15872024-08-16T07:17:33.489ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 049b6b8d-62e1-417f-afbc-1dec658a8bc4 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
15882024-08-16T07:17:33.491ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2192 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 049b6b8d-62e1-417f-afbc-1dec658a8bc4 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
15892024-08-16T07:17:34.510ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 08f44952-5ba5-44b5-b94e-86da4bd22d5a roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
15902024-08-16T07:17:34.510ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 08f44952-5ba5-44b5-b94e-86da4bd22d5a resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
15912024-08-16T07:17:34.511ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1916 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 08f44952-5ba5-44b5-b94e-86da4bd22d5a response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
15922024-08-16T07:17:35.531ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = ddd9934c-b133-4e59-a9ed-cba4cf989469 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
15932024-08-16T07:17:35.531ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = ddd9934c-b133-4e59-a9ed-cba4cf989469 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
15942024-08-16T07:17:35.532ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1791 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = ddd9934c-b133-4e59-a9ed-cba4cf989469 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
15952024-08-16T07:17:36.552ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 39040966-532b-4023-bd70-84ab9f60c832 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
15962024-08-16T07:17:36.552ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 39040966-532b-4023-bd70-84ab9f60c832 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
15972024-08-16T07:17:36.553ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1663 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 39040966-532b-4023-bd70-84ab9f60c832 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
15982024-08-16T07:17:37.572ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 5d690cc3-105d-4c88-8e30-ac437cd5d3ef roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
15992024-08-16T07:17:37.572ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 5d690cc3-105d-4c88-8e30-ac437cd5d3ef resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
16002024-08-16T07:17:37.574ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1981 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 5d690cc3-105d-4c88-8e30-ac437cd5d3ef response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
16012024-08-16T07:17:38.593ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = f0020b09-5de4-4f84-9034-d8d844fc5e6b roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
16022024-08-16T07:17:38.593ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = f0020b09-5de4-4f84-9034-d8d844fc5e6b resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
16032024-08-16T07:17:38.595ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1831 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = f0020b09-5de4-4f84-9034-d8d844fc5e6b response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
16042024-08-16T07:17:39.615ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 38651618-7ac5-454a-a36b-dd2b71f5fa5b roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
16052024-08-16T07:17:39.615ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 38651618-7ac5-454a-a36b-dd2b71f5fa5b resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
16062024-08-16T07:17:39.617ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1888 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 38651618-7ac5-454a-a36b-dd2b71f5fa5b response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
16072024-08-16T07:17:40.635ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = e7012f68-7515-45ea-85be-b2157d7636f5 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
16082024-08-16T07:17:40.636ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = e7012f68-7515-45ea-85be-b2157d7636f5 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
16092024-08-16T07:17:40.637ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1813 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = e7012f68-7515-45ea-85be-b2157d7636f5 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
16102024-08-16T07:17:40.856ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 6 reason = Timeout
16112024-08-16T07:17:40.856ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16122024-08-16T07:17:40.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16132024-08-16T07:17:40.858ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16142024-08-16T07:17:40.860ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
16152024-08-16T07:17:40.860ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16162024-08-16T07:17:40.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16172024-08-16T07:17:40.862ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16182024-08-16T07:17:40.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16192024-08-16T07:17:40.863ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 6 reason = Timeout
16202024-08-16T07:17:40.863ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
16212024-08-16T07:17:40.863ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16222024-08-16T07:17:40.863ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16232024-08-16T07:17:40.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16242024-08-16T07:17:40.864ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16252024-08-16T07:17:40.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16262024-08-16T07:17:40.865ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
16272024-08-16T07:17:40.865ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16282024-08-16T07:17:40.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16292024-08-16T07:17:40.871ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
16302024-08-16T07:17:40.871ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 14.968935ms iteration = 6 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
16312024-08-16T07:17:40.889ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
16322024-08-16T07:17:40.889ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 26.145674ms iteration = 6 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
16332024-08-16T07:17:41.657ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 4c654f50-ffac-4d4b-9626-c219abbca65d roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
16342024-08-16T07:17:41.657ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 4c654f50-ffac-4d4b-9626-c219abbca65d resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
16352024-08-16T07:17:41.658ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1595 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 4c654f50-ffac-4d4b-9626-c219abbca65d response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
16362024-08-16T07:17:42.678ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 6f11c84b-2dc4-4cba-81ab-596c359b3d3c roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
16372024-08-16T07:17:42.678ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 6f11c84b-2dc4-4cba-81ab-596c359b3d3c resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
16382024-08-16T07:17:42.680ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2232 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 6f11c84b-2dc4-4cba-81ab-596c359b3d3c response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
16392024-08-16T07:17:43.699ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = b7aa1184-1c8a-4931-9eb6-9743bdc18186 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
16402024-08-16T07:17:43.699ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = b7aa1184-1c8a-4931-9eb6-9743bdc18186 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
16412024-08-16T07:17:43.700ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1809 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = b7aa1184-1c8a-4931-9eb6-9743bdc18186 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
16422024-08-16T07:17:44.719ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 76c3ecbb-fe88-41d7-9226-1555b71d88a0 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
16432024-08-16T07:17:44.720ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 76c3ecbb-fe88-41d7-9226-1555b71d88a0 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
16442024-08-16T07:17:44.721ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1813 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 76c3ecbb-fe88-41d7-9226-1555b71d88a0 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
16452024-08-16T07:17:45.741ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 7576f2b8-1595-4871-b007-488b6ca2d9d8 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
16462024-08-16T07:17:45.741ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 7576f2b8-1595-4871-b007-488b6ca2d9d8 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
16472024-08-16T07:17:45.743ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1852 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 7576f2b8-1595-4871-b007-488b6ca2d9d8 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
16482024-08-16T07:17:46.763ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 06a9932c-543a-461c-8af6-6b7cd65e2470 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
16492024-08-16T07:17:46.763ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 06a9932c-543a-461c-8af6-6b7cd65e2470 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
16502024-08-16T07:17:46.765ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2067 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 06a9932c-543a-461c-8af6-6b7cd65e2470 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
16512024-08-16T07:17:47.784ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = a6180527-86f7-403d-b2ec-4b6c4c000221 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
16522024-08-16T07:17:47.784ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = a6180527-86f7-403d-b2ec-4b6c4c000221 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
16532024-08-16T07:17:47.785ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2158 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = a6180527-86f7-403d-b2ec-4b6c4c000221 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
16542024-08-16T07:17:48.804ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 5d24b6c4-6e17-4956-b787-bdac196e0c06 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
16552024-08-16T07:17:48.805ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 5d24b6c4-6e17-4956-b787-bdac196e0c06 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
16562024-08-16T07:17:48.806ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1554 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 5d24b6c4-6e17-4956-b787-bdac196e0c06 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
16572024-08-16T07:17:49.826ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = c9fc058e-5d80-40a0-9cd2-fbea11044aad roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
16582024-08-16T07:17:49.826ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = c9fc058e-5d80-40a0-9cd2-fbea11044aad resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
16592024-08-16T07:17:49.827ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1628 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = c9fc058e-5d80-40a0-9cd2-fbea11044aad response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
16602024-08-16T07:17:50.847ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 97519f2c-44ee-400f-b2d6-743417020f8e roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
16612024-08-16T07:17:50.848ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 97519f2c-44ee-400f-b2d6-743417020f8e resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
16622024-08-16T07:17:50.849ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2032 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 97519f2c-44ee-400f-b2d6-743417020f8e response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
16632024-08-16T07:17:50.856ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 2 reason = Timeout
16642024-08-16T07:17:50.856ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
16652024-08-16T07:17:50.856ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 7 reason = Timeout
16662024-08-16T07:17:50.856ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
16672024-08-16T07:17:50.856ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 2 reason = Timeout
16682024-08-16T07:17:50.856ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16692024-08-16T07:17:50.856ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 3 reason = Timeout
16702024-08-16T07:17:50.856ZWARNnexus (BackgroundTasks): phantom disk task started background_task = phantom_disks file = nexus/src/app/background/tasks/phantom_disks.rs:46
16712024-08-16T07:17:50.856ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 3 reason = Timeout
16722024-08-16T07:17:50.856ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 2 reason = Timeout
16732024-08-16T07:17:50.856ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-08-16 07:07:50.856800559 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
16742024-08-16T07:17:50.856ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
16752024-08-16T07:17:50.856ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
16762024-08-16T07:17:50.856ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 3 reason = Timeout
16772024-08-16T07:17:50.856ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:69 reason = blueprint disabled target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d
16782024-08-16T07:17:50.856ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 2 reason = Timeout
16792024-08-16T07:17:50.856ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
16802024-08-16T07:17:50.856ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 15.741\u{b5}s iteration = 3 status = {"error":"blueprint disabled","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d"}
16812024-08-16T07:17:50.856ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
16822024-08-16T07:17:50.856ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 3 reason = Timeout
16832024-08-16T07:17:50.856ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 2 reason = Timeout
16842024-08-16T07:17:50.856ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 2 reason = Timeout
16852024-08-16T07:17:50.856ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
16862024-08-16T07:17:50.856ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 4.55\u{b5}s iteration = 3 status = {"error":"no config"}
16872024-08-16T07:17:50.856ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
16882024-08-16T07:17:50.856ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 3 reason = Timeout
16892024-08-16T07:17:50.856ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
16902024-08-16T07:17:50.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
16912024-08-16T07:17:50.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
16922024-08-16T07:17:50.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
16932024-08-16T07:17:50.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16942024-08-16T07:17:50.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
16952024-08-16T07:17:50.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
16962024-08-16T07:17:50.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
16972024-08-16T07:17:50.857ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6d6264ea-5d56-4938-8c26-581ed0b9907b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a8440aa3-608b-4c08-b70c-6d92a9461396.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("aea2243f-052e-4953-bdfa-7c3368895dd2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("aea2243f-052e-4953-bdfa-7c3368895dd2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1134, tv_nsec: 232961422 } })
16982024-08-16T07:17:50.857ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
16992024-08-16T07:17:50.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
17002024-08-16T07:17:50.857ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 2 reason = Timeout
17012024-08-16T07:17:50.857ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
17022024-08-16T07:17:50.857ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 5 reason = Timeout
17032024-08-16T07:17:50.857ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
17042024-08-16T07:17:50.857ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
17052024-08-16T07:17:50.857ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
17062024-08-16T07:17:50.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
17072024-08-16T07:17:50.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
17082024-08-16T07:17:50.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
17092024-08-16T07:17:50.858ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("dec19c15-1a2d-47ac-9b9e-9f424d3a3464.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f9649eef-936b-4765-9810-da8662275db5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f9649eef-936b-4765-9810-da8662275db5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1134, tv_nsec: 233759391 } })
17102024-08-16T07:17:50.858ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17112024-08-16T07:17:50.859ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17122024-08-16T07:17:50.859ZWARNnexus (BackgroundTasks): phantom disk task done background_task = phantom_disks file = nexus/src/app/background/tasks/phantom_disks.rs:93
17132024-08-16T07:17:50.859ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.429816ms iteration = 3 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
17142024-08-16T07:17:50.859ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
17152024-08-16T07:17:50.859ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 2.932708ms iteration = 2 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
17162024-08-16T07:17:50.859ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17172024-08-16T07:17:50.860ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17182024-08-16T07:17:50.860ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
17192024-08-16T07:17:50.860ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 3.681135ms iteration = 2 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
17202024-08-16T07:17:50.860ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1134, tv_nsec: 236092334 } })
17212024-08-16T07:17:50.861ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
17222024-08-16T07:17:50.861ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-08-16 07:07:50.856800559 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
17232024-08-16T07:17:50.861ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 5.150289ms iteration = 2 status = {"expiration":"2024-08-16T07:07:50.856800559Z","pruned":[]}
17242024-08-16T07:17:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
17252024-08-16T07:17:50.862ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
17262024-08-16T07:17:50.862ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1134, tv_nsec: 237546758 } })
17272024-08-16T07:17:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
17282024-08-16T07:17:50.862ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
17292024-08-16T07:17:50.862ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
17302024-08-16T07:17:50.862ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
17312024-08-16T07:17:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
17322024-08-16T07:17:50.863ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17332024-08-16T07:17:50.863ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
17342024-08-16T07:17:50.863ZWARNnexus (BackgroundTasks): physical disk adoption task started background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:100
17352024-08-16T07:17:50.863ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 3 reason = Timeout
17362024-08-16T07:17:50.863ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
17372024-08-16T07:17:50.863ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17382024-08-16T07:17:50.863ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 3 reason = Timeout
17392024-08-16T07:17:50.863ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17402024-08-16T07:17:50.863ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 3 reason = Timeout
17412024-08-16T07:17:50.863ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
17422024-08-16T07:17:50.863ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 6.211\u{b5}s iteration = 3 status = {"error":"no config"}
17432024-08-16T07:17:50.863ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 2 reason = Timeout
17442024-08-16T07:17:50.863ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 2 reason = Timeout
17452024-08-16T07:17:50.863ZINFOnexus (BackgroundTasks): lookup region port task started background_task = lookup_region_port file = nexus/src/app/background/tasks/lookup_region_port.rs:56
17462024-08-16T07:17:50.863ZINFOnexus (BackgroundTasks): Abandoned VMM reaper running background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:76
17472024-08-16T07:17:50.863ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
17482024-08-16T07:17:50.863ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
17492024-08-16T07:17:50.863ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 3 reason = Timeout
17502024-08-16T07:17:50.863ZINFOnexus (BackgroundTasks): region snapshot replacement start task started background_task = region_snapshot_replacement_start file = nexus/src/app/background/tasks/region_snapshot_replacement_start.rs:236
17512024-08-16T07:17:50.863ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
17522024-08-16T07:17:50.863ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 3 reason = Timeout
17532024-08-16T07:17:50.863ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
17542024-08-16T07:17:50.863ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
17552024-08-16T07:17:50.863ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 3 reason = Timeout
17562024-08-16T07:17:50.863ZWARNnexus (BackgroundTasks): region replacement task started background_task = region_replacement file = nexus/src/app/background/tasks/region_replacement.rs:64
17572024-08-16T07:17:50.863ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 3 reason = Timeout
17582024-08-16T07:17:50.863ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
17592024-08-16T07:17:50.863ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17602024-08-16T07:17:50.863ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 3 reason = Timeout
17612024-08-16T07:17:50.863ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 3 reason = Timeout
17622024-08-16T07:17:50.863ZINFOnexus (BackgroundTasks): region snapshot replacement garbage collect task started background_task = region_snapshot_replacement_garbage_collection file = nexus/src/app/background/tasks/region_snapshot_replacement_garbage_collect.rs:133
17632024-08-16T07:17:50.863ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 7 reason = Timeout
17642024-08-16T07:17:50.863ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
17652024-08-16T07:17:50.863ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
17662024-08-16T07:17:50.863ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
17672024-08-16T07:17:50.863ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17682024-08-16T07:17:50.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17692024-08-16T07:17:50.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
17702024-08-16T07:17:50.863ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 3 reason = Timeout
17712024-08-16T07:17:50.863ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17722024-08-16T07:17:50.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
17732024-08-16T07:17:50.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
17742024-08-16T07:17:50.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
17752024-08-16T07:17:50.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17762024-08-16T07:17:50.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
17772024-08-16T07:17:50.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
17782024-08-16T07:17:50.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17792024-08-16T07:17:50.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17802024-08-16T07:17:50.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
17812024-08-16T07:17:50.864ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17822024-08-16T07:17:50.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17832024-08-16T07:17:50.864ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
17842024-08-16T07:17:50.864ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17852024-08-16T07:17:50.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
17862024-08-16T07:17:50.864ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
17872024-08-16T07:17:50.864ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
17882024-08-16T07:17:50.864ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
17892024-08-16T07:17:50.864ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
17902024-08-16T07:17:50.864ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
17912024-08-16T07:17:50.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17922024-08-16T07:17:50.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
17932024-08-16T07:17:50.864ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17942024-08-16T07:17:50.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
17952024-08-16T07:17:50.864ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17962024-08-16T07:17:50.865ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17972024-08-16T07:17:50.865ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17982024-08-16T07:17:50.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17992024-08-16T07:17:50.865ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18002024-08-16T07:17:50.866ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18012024-08-16T07:17:50.866ZINFOnexus (BackgroundTasks): lookup region port task done background_task = lookup_region_port file = nexus/src/app/background/tasks/lookup_region_port.rs:150
18022024-08-16T07:17:50.866ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 3.209404ms iteration = 2 status = {"errors":[],"found_port_ok":[]}
18032024-08-16T07:17:50.867ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
18042024-08-16T07:17:50.867ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
18052024-08-16T07:17:50.867ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
18062024-08-16T07:17:50.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
18072024-08-16T07:17:50.868ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
18082024-08-16T07:17:50.868ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
18092024-08-16T07:17:50.868ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
18102024-08-16T07:17:50.868ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18112024-08-16T07:17:50.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
18122024-08-16T07:17:50.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18132024-08-16T07:17:50.868ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
18142024-08-16T07:17:50.868ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
18152024-08-16T07:17:50.868ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
18162024-08-16T07:17:50.868ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18172024-08-16T07:17:50.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
18182024-08-16T07:17:50.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18192024-08-16T07:17:50.869ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18202024-08-16T07:17:50.869ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
18212024-08-16T07:17:50.869ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18222024-08-16T07:17:50.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18232024-08-16T07:17:50.871ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
18242024-08-16T07:17:50.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
18252024-08-16T07:17:50.872ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
18262024-08-16T07:17:50.872ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
18272024-08-16T07:17:50.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
18282024-08-16T07:17:50.873ZWARNnexus (BackgroundTasks): region replacement task done background_task = region_replacement file = nexus/src/app/background/tasks/region_replacement.rs:185
18292024-08-16T07:17:50.873ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 9.97411ms iteration = 3 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
18302024-08-16T07:17:50.874ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
18312024-08-16T07:17:50.874ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 11.358683ms iteration = 3 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
18322024-08-16T07:17:50.875ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
18332024-08-16T07:17:50.875ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.359524ms iteration = 7 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
18342024-08-16T07:17:50.878ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18352024-08-16T07:17:50.879ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1134, tv_nsec: 255241927 } })
18362024-08-16T07:17:50.881ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18372024-08-16T07:17:50.881ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
18382024-08-16T07:17:50.881ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
18392024-08-16T07:17:50.882ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
18402024-08-16T07:17:50.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18412024-08-16T07:17:50.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
18422024-08-16T07:17:50.882ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18432024-08-16T07:17:50.884ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
18442024-08-16T07:17:50.884ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18452024-08-16T07:17:50.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18462024-08-16T07:17:50.890ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18472024-08-16T07:17:50.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18482024-08-16T07:17:50.903ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
18492024-08-16T07:17:50.903ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
18502024-08-16T07:17:50.903ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
18512024-08-16T07:17:50.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
18522024-08-16T07:17:50.904ZINFOnexus (BackgroundTasks): region snapshot replacement garbage collect task done background_task = region_snapshot_replacement_garbage_collection file = nexus/src/app/background/tasks/region_snapshot_replacement_garbage_collect.rs:147
18532024-08-16T07:17:50.904ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 40.71611ms iteration = 3 status = {"errors":[],"garbage_collect_requested":[]}
18542024-08-16T07:17:50.904ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
18552024-08-16T07:17:50.904ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
18562024-08-16T07:17:50.904ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
18572024-08-16T07:17:50.904ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
18582024-08-16T07:17:50.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
18592024-08-16T07:17:50.905ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18602024-08-16T07:17:50.905ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
18612024-08-16T07:17:50.905ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
18622024-08-16T07:17:50.905ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 47.972978ms iteration = 2 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
18632024-08-16T07:17:50.905ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
18642024-08-16T07:17:50.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
18652024-08-16T07:17:50.906ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
18662024-08-16T07:17:50.907ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18672024-08-16T07:17:50.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
18682024-08-16T07:17:50.907ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18692024-08-16T07:17:50.908ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
18702024-08-16T07:17:50.908ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
18712024-08-16T07:17:50.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
18722024-08-16T07:17:50.909ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
18732024-08-16T07:17:50.909ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
18742024-08-16T07:17:50.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
18752024-08-16T07:17:50.910ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
18762024-08-16T07:17:50.910ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = ddebb22e-3faa-4936-9b3e-0f4d28827c0e dns_zone_name = oxide.test found_so_far = 0 version = 2
18772024-08-16T07:17:50.910ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
18782024-08-16T07:17:50.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
18792024-08-16T07:17:50.910ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
18802024-08-16T07:17:50.910ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18812024-08-16T07:17:50.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18822024-08-16T07:17:50.911ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18832024-08-16T07:17:50.914ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
18842024-08-16T07:17:50.914ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
18852024-08-16T07:17:50.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
18862024-08-16T07:17:50.917ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
18872024-08-16T07:17:50.917ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 2c55b660-f328-498e-b44c-73da75015ed4 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
18882024-08-16T07:17:50.917ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
18892024-08-16T07:17:50.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
18902024-08-16T07:17:50.919ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18912024-08-16T07:17:50.919ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = ddebb22e-3faa-4936-9b3e-0f4d28827c0e dns_zone_name = oxide.test found_so_far = 1 version = 2
18922024-08-16T07:17:50.919ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
18932024-08-16T07:17:50.919ZINFOnexus (BackgroundTasks): found latest generation (first find) background_task = dns_config_external dns_group = external file = nexus/src/app/background/tasks/dns_config.rs:87 generation = 2
18942024-08-16T07:17:50.919ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 62.335299ms iteration = 2 status = {"generation":2}
18952024-08-16T07:17:50.919ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 4 reason = Dependency
18962024-08-16T07:17:50.922ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
18972024-08-16T07:17:50.922ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
18982024-08-16T07:17:50.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
18992024-08-16T07:17:50.926ZWARNnexus (BackgroundTasks): physical disk adoption task done background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:174
19002024-08-16T07:17:50.926ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 68.998534ms iteration = 5 status = {"physical_disks_added":0}
19012024-08-16T07:17:50.927ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19022024-08-16T07:17:50.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19032024-08-16T07:17:50.927ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
19042024-08-16T07:17:50.927ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 64.07938ms iteration = 7 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
19052024-08-16T07:17:50.929ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 2c55b660-f328-498e-b44c-73da75015ed4 dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
19062024-08-16T07:17:50.929ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
19072024-08-16T07:17:50.929ZINFOnexus (BackgroundTasks): found latest generation (first find) background_task = dns_config_internal dns_group = internal file = nexus/src/app/background/tasks/dns_config.rs:87 generation = 1
19082024-08-16T07:17:50.929ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 72.755481ms iteration = 2 status = {"generation":1}
19092024-08-16T07:17:50.929ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 4 reason = Dependency
19102024-08-16T07:17:50.932ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19112024-08-16T07:17:50.932ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19122024-08-16T07:17:50.934ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19132024-08-16T07:17:50.934ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19142024-08-16T07:17:50.935ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19152024-08-16T07:17:50.937ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae, lookup_type: ById(03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae) } result = Ok(())
19162024-08-16T07:17:50.937ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19172024-08-16T07:17:50.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19182024-08-16T07:17:50.939ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 75.385681ms iteration = 3 status = 0
19192024-08-16T07:17:50.940ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
19202024-08-16T07:17:50.940ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
19212024-08-16T07:17:50.940ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 76.986827ms iteration = 3 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
19222024-08-16T07:17:50.940ZINFOnexus (BackgroundTasks): region snapshot replacement start task done background_task = region_snapshot_replacement_start file = nexus/src/app/background/tasks/region_snapshot_replacement_start.rs:252
19232024-08-16T07:17:50.941ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 77.421148ms iteration = 3 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
19242024-08-16T07:17:50.944ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
19252024-08-16T07:17:50.944ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
19262024-08-16T07:17:50.944ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "3084b715-46fd-4667-87e6-b20c7c5dc284", "content-length": "26", "date": "Fri, 16 Aug 2024 07:17:50 GMT"} })
19272024-08-16T07:17:50.944ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
19282024-08-16T07:17:50.945ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
19292024-08-16T07:17:50.968ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19302024-08-16T07:17:50.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19312024-08-16T07:17:50.969ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19322024-08-16T07:17:50.971ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
19332024-08-16T07:17:50.971ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19342024-08-16T07:17:50.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19352024-08-16T07:17:50.972ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19362024-08-16T07:17:50.973ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
19372024-08-16T07:17:50.973ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19382024-08-16T07:17:50.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19392024-08-16T07:17:50.981ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
19402024-08-16T07:17:50.981ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
19412024-08-16T07:17:50.981ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f5cc221a-9fc3-4ad8-bfe1-e3493c5a01cf", "content-length": "26", "date": "Fri, 16 Aug 2024 07:17:50 GMT"} })
19422024-08-16T07:17:50.982ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
19432024-08-16T07:17:50.983ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
19442024-08-16T07:17:50.995ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a zone_address = fd00:1122:3344:101::2
19452024-08-16T07:17:50.995ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
19462024-08-16T07:17:50.995ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ee2d14b0-1ad6-416c-aaa1-08b803c3298c", "content-length": "26", "date": "Fri, 16 Aug 2024 07:17:50 GMT"} })
19472024-08-16T07:17:50.995ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
19482024-08-16T07:17:50.997ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
19492024-08-16T07:17:51.027ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
19502024-08-16T07:17:51.027ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
19512024-08-16T07:17:51.027ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 163.631079ms iteration = 2 status = {"error":null,"error_count":0,"found":0,"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0}
19522024-08-16T07:17:51.105ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
19532024-08-16T07:17:51.105ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "78c58ec6-2e00-460f-8c64-d46610c1b49b", "content-length": "372", "date": "Fri, 16 Aug 2024 07:17:51 GMT"} })
19542024-08-16T07:17:51.105ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19552024-08-16T07:17:51.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19562024-08-16T07:17:51.107ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19572024-08-16T07:17:51.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19582024-08-16T07:17:51.109ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19592024-08-16T07:17:51.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19602024-08-16T07:17:51.112ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
19612024-08-16T07:17:51.114ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "7df110f1-1fb3-4716-9fe1-fc4e8f06b2cb", "date": "Fri, 16 Aug 2024 07:17:51 GMT"} })
19622024-08-16T07:17:51.115ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 252.195934ms iteration = 3 status = {}
19632024-08-16T07:17:51.120ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
19642024-08-16T07:17:51.143ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
19652024-08-16T07:17:51.151ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 294.680386ms iteration = 3 status = {}
19662024-08-16T07:17:51.157ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (initial) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-08-16T07:16:49.943339Z, time_modified: 2024-08-16T07:16:49.943339Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, db_silo: Silo { identity: SiloIdentity { id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-16T07:16:55.682566Z, time_modified: 2024-08-16T07:16:55.682566Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(2)) }, tls_certs: [TlsCertificate { digest: "c9e400628d2b58a74b998fbfa44a053952e83a6e8d3c49e6518981bf7d4a006f" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, db_silo: Silo { identity: SiloIdentity { id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-16T07:16:55.682566Z, time_modified: 2024-08-16T07:16:55.682566Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(2)) }, tls_certs: [TlsCertificate { digest: "c9e400628d2b58a74b998fbfa44a053952e83a6e8d3c49e6518981bf7d4a006f" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:77
19672024-08-16T07:17:51.157ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 300.365237ms iteration = 2 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071","tls_certs":["c9e400628d2b58a74b998fbfa44a053952e83a6e8d3c49e6518981bf7d4a006f"]}},"default_endpoint":{"silo_id":"439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071","tls_certs":["c9e400628d2b58a74b998fbfa44a053952e83a6e8d3c49e6518981bf7d4a006f"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
19682024-08-16T07:17:51.206ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /
19692024-08-16T07:17:51.206ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /access
19702024-08-16T07:17:51.206ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /assets/{path}
19712024-08-16T07:17:51.206ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /device/auth
19722024-08-16T07:17:51.206ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /device/confirm
19732024-08-16T07:17:51.206ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /device/success
19742024-08-16T07:17:51.206ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /device/token
19752024-08-16T07:17:51.206ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /device/verify
19762024-08-16T07:17:51.206ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /experimental/v1/probes
19772024-08-16T07:17:51.206ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /experimental/v1/probes
19782024-08-16T07:17:51.206ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /experimental/v1/probes/{probe}
19792024-08-16T07:17:51.206ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /experimental/v1/probes/{probe}
19802024-08-16T07:17:51.206ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /images
19812024-08-16T07:17:51.206ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /login
19822024-08-16T07:17:51.206ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /login/{silo_name}/local
19832024-08-16T07:17:51.206ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /login/{silo_name}/saml/{provider_name}
19842024-08-16T07:17:51.206ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /login/{silo_name}/saml/{provider_name}
19852024-08-16T07:17:51.206ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /login/{silo_name}/saml/{provider_name}/redirect
19862024-08-16T07:17:51.206ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /lookup/{path}
19872024-08-16T07:17:51.206ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /projects/{path}
19882024-08-16T07:17:51.206ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /projects-new
19892024-08-16T07:17:51.206ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /settings/{path}
19902024-08-16T07:17:51.206ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /system/{path}
19912024-08-16T07:17:51.206ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /utilization
19922024-08-16T07:17:51.206ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/certificates
19932024-08-16T07:17:51.206ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/certificates
19942024-08-16T07:17:51.206ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/certificates/{certificate}
19952024-08-16T07:17:51.206ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/certificates/{certificate}
19962024-08-16T07:17:51.206ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/disks
19972024-08-16T07:17:51.206ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/disks
19982024-08-16T07:17:51.206ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/disks/{disk}
19992024-08-16T07:17:51.206ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/disks/{disk}
20002024-08-16T07:17:51.206ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/disks/{disk}/bulk-write
20012024-08-16T07:17:51.206ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/disks/{disk}/bulk-write-start
20022024-08-16T07:17:51.206ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/disks/{disk}/bulk-write-stop
20032024-08-16T07:17:51.206ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/disks/{disk}/finalize
20042024-08-16T07:17:51.206ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/disks/{disk}/metrics/{metric}
20052024-08-16T07:17:51.206ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/floating-ips
20062024-08-16T07:17:51.206ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/floating-ips
20072024-08-16T07:17:51.206ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/floating-ips/{floating_ip}
20082024-08-16T07:17:51.206ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/floating-ips/{floating_ip}
20092024-08-16T07:17:51.206ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/floating-ips/{floating_ip}
20102024-08-16T07:17:51.206ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/floating-ips/{floating_ip}/attach
20112024-08-16T07:17:51.206ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/floating-ips/{floating_ip}/detach
20122024-08-16T07:17:51.206ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/groups
20132024-08-16T07:17:51.206ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/groups/{group_id}
20142024-08-16T07:17:51.206ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/images
20152024-08-16T07:17:51.206ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/images
20162024-08-16T07:17:51.206ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/images/{image}
20172024-08-16T07:17:51.206ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/images/{image}
20182024-08-16T07:17:51.206ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/images/{image}/demote
20192024-08-16T07:17:51.206ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/images/{image}/promote
20202024-08-16T07:17:51.206ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances
20212024-08-16T07:17:51.206ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances
20222024-08-16T07:17:51.206ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/instances/{instance}
20232024-08-16T07:17:51.206ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance}
20242024-08-16T07:17:51.206ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance}/disks
20252024-08-16T07:17:51.206ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/disks/attach
20262024-08-16T07:17:51.206ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/disks/detach
20272024-08-16T07:17:51.206ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance}/external-ips
20282024-08-16T07:17:51.206ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/instances/{instance}/external-ips/ephemeral
20292024-08-16T07:17:51.206ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/external-ips/ephemeral
20302024-08-16T07:17:51.206ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/reboot
20312024-08-16T07:17:51.206ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance}/serial-console
20322024-08-16T07:17:51.206ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance}/serial-console/stream
20332024-08-16T07:17:51.206ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance}/ssh-public-keys
20342024-08-16T07:17:51.206ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/start
20352024-08-16T07:17:51.206ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/stop
20362024-08-16T07:17:51.206ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/ip-pools
20372024-08-16T07:17:51.206ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/ip-pools/{pool}
20382024-08-16T07:17:51.206ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/login/{silo_name}/local
20392024-08-16T07:17:51.206ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/logout
20402024-08-16T07:17:51.206ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/me
20412024-08-16T07:17:51.206ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/me/groups
20422024-08-16T07:17:51.206ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/me/ssh-keys
20432024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/me/ssh-keys
20442024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/me/ssh-keys/{ssh_key}
20452024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/me/ssh-keys/{ssh_key}
20462024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/metrics/{metric_name}
20472024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/network-interfaces
20482024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/network-interfaces
20492024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/network-interfaces/{interface}
20502024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/network-interfaces/{interface}
20512024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/network-interfaces/{interface}
20522024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/ping
20532024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/policy
20542024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/policy
20552024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/projects
20562024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/projects
20572024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/projects/{project}
20582024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/projects/{project}
20592024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/projects/{project}
20602024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/projects/{project}/policy
20612024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/projects/{project}/policy
20622024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/snapshots
20632024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/snapshots
20642024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/snapshots/{snapshot}
20652024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/snapshots/{snapshot}
20662024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/disks
20672024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/disks/{disk_id}
20682024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/racks
20692024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/racks/{rack_id}
20702024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/sleds
20712024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/hardware/sleds
20722024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/sleds/{sled_id}
20732024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/sleds/{sled_id}/disks
20742024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/sleds/{sled_id}/instances
20752024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/hardware/sleds/{sled_id}/provision-policy
20762024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/sleds-uninitialized
20772024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/switch-port
20782024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/hardware/switch-port/{port}/settings
20792024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/hardware/switch-port/{port}/settings
20802024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/switch-port/{port}/status
20812024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/switches
20822024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/switches/{switch_id}
20832024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/identity-providers
20842024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/identity-providers/local/users
20852024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/identity-providers/local/users/{user_id}
20862024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/identity-providers/local/users/{user_id}/set-password
20872024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/identity-providers/saml
20882024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/identity-providers/saml/{provider}
20892024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools
20902024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools
20912024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/ip-pools/{pool}
20922024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools/{pool}
20932024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/ip-pools/{pool}
20942024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools/{pool}/ranges
20952024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools/{pool}/ranges/add
20962024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools/{pool}/ranges/remove
20972024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools/{pool}/silos
20982024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools/{pool}/silos
20992024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/ip-pools/{pool}/silos/{silo}
21002024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/ip-pools/{pool}/silos/{silo}
21012024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools/{pool}/utilization
21022024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools-service
21032024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools-service/ranges
21042024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools-service/ranges/add
21052024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools-service/ranges/remove
21062024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/metrics/{metric_name}
21072024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/address-lot
21082024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/address-lot
21092024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/networking/address-lot/{address_lot}
21102024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/address-lot/{address_lot}/blocks
21112024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/allow-list
21122024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/networking/allow-list
21132024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/bfd-disable
21142024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/bfd-enable
21152024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bfd-status
21162024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/networking/bgp
21172024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp
21182024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/bgp
21192024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/networking/bgp-announce
21202024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-announce
21212024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/networking/bgp-announce
21222024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-message-history
21232024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-routes-ipv4
21242024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-status
21252024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/loopback-address
21262024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/loopback-address
21272024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/networking/loopback-address/{rack_id}/{switch_location}/{address}/{subnet_mask}
21282024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/networking/switch-port-settings
21292024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/switch-port-settings
21302024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/switch-port-settings
21312024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/switch-port-settings/{port}
21322024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/policy
21332024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/policy
21342024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/roles
21352024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/roles/{role_name}
21362024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silo-quotas
21372024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silos
21382024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/silos
21392024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/silos/{silo}
21402024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silos/{silo}
21412024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silos/{silo}/ip-pools
21422024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silos/{silo}/policy
21432024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/silos/{silo}/policy
21442024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silos/{silo}/quotas
21452024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/silos/{silo}/quotas
21462024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/update/repository
21472024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/update/repository/{system_version}
21482024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/users
21492024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/users/{user_id}
21502024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/users-builtin
21512024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/users-builtin/{user}
21522024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/utilization/silos
21532024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/utilization/silos/{silo}
21542024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/timeseries/query
21552024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/timeseries/schema
21562024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/users
21572024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/utilization
21582024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-firewall-rules
21592024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/vpc-firewall-rules
21602024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-router-routes
21612024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/vpc-router-routes
21622024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/vpc-router-routes/{route}
21632024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-router-routes/{route}
21642024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/vpc-router-routes/{route}
21652024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-routers
21662024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/vpc-routers
21672024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/vpc-routers/{router}
21682024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-routers/{router}
21692024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/vpc-routers/{router}
21702024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-subnets
21712024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/vpc-subnets
21722024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/vpc-subnets/{subnet}
21732024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-subnets/{subnet}
21742024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/vpc-subnets/{subnet}
21752024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-subnets/{subnet}/network-interfaces
21762024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpcs
21772024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/vpcs
21782024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/vpcs/{vpc}
21792024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpcs/{vpc}
21802024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/vpcs/{vpc}
21812024-08-16T07:17:51.207ZINFOnexus (dropshot_external): listening file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:205 local_addr = 172.30.2.7:443
21822024-08-16T07:17:51.207ZDEBGnexus (dropshot_external): successfully registered DTrace USDT probes local_addr = 172.30.2.7:443
21832024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /
21842024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /access
21852024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /assets/{path}
21862024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /device/auth
21872024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /device/confirm
21882024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /device/success
21892024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /device/token
21902024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /device/verify
21912024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /experimental/v1/probes
21922024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /experimental/v1/probes
21932024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /experimental/v1/probes/{probe}
21942024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /experimental/v1/probes/{probe}
21952024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /images
21962024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /login
21972024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /login/{silo_name}/local
21982024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /login/{silo_name}/saml/{provider_name}
21992024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /login/{silo_name}/saml/{provider_name}
22002024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /login/{silo_name}/saml/{provider_name}/redirect
22012024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /lookup/{path}
22022024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /projects/{path}
22032024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /projects-new
22042024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /settings/{path}
22052024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /system/{path}
22062024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /utilization
22072024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/certificates
22082024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/certificates
22092024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/certificates/{certificate}
22102024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/certificates/{certificate}
22112024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/disks
22122024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/disks
22132024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/disks/{disk}
22142024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/disks/{disk}
22152024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/disks/{disk}/bulk-write
22162024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/disks/{disk}/bulk-write-start
22172024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/disks/{disk}/bulk-write-stop
22182024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/disks/{disk}/finalize
22192024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/disks/{disk}/metrics/{metric}
22202024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/floating-ips
22212024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/floating-ips
22222024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/floating-ips/{floating_ip}
22232024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/floating-ips/{floating_ip}
22242024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/floating-ips/{floating_ip}
22252024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/floating-ips/{floating_ip}/attach
22262024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/floating-ips/{floating_ip}/detach
22272024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/groups
22282024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/groups/{group_id}
22292024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/images
22302024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/images
22312024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/images/{image}
22322024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/images/{image}
22332024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/images/{image}/demote
22342024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/images/{image}/promote
22352024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances
22362024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances
22372024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/instances/{instance}
22382024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance}
22392024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance}/disks
22402024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/disks/attach
22412024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/disks/detach
22422024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance}/external-ips
22432024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/instances/{instance}/external-ips/ephemeral
22442024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/external-ips/ephemeral
22452024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/reboot
22462024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance}/serial-console
22472024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance}/serial-console/stream
22482024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance}/ssh-public-keys
22492024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/start
22502024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/stop
22512024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/ip-pools
22522024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/ip-pools/{pool}
22532024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/login/{silo_name}/local
22542024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/logout
22552024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/me
22562024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/me/groups
22572024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/me/ssh-keys
22582024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/me/ssh-keys
22592024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/me/ssh-keys/{ssh_key}
22602024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/me/ssh-keys/{ssh_key}
22612024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/metrics/{metric_name}
22622024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/network-interfaces
22632024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/network-interfaces
22642024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/network-interfaces/{interface}
22652024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/network-interfaces/{interface}
22662024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/network-interfaces/{interface}
22672024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/ping
22682024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/policy
22692024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/policy
22702024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/projects
22712024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/projects
22722024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/projects/{project}
22732024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/projects/{project}
22742024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/projects/{project}
22752024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/projects/{project}/policy
22762024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/projects/{project}/policy
22772024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/snapshots
22782024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/snapshots
22792024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/snapshots/{snapshot}
22802024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/snapshots/{snapshot}
22812024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/disks
22822024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/disks/{disk_id}
22832024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/racks
22842024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/racks/{rack_id}
22852024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/sleds
22862024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/hardware/sleds
22872024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/sleds/{sled_id}
22882024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/sleds/{sled_id}/disks
22892024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/sleds/{sled_id}/instances
22902024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/hardware/sleds/{sled_id}/provision-policy
22912024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/sleds-uninitialized
22922024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/switch-port
22932024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/hardware/switch-port/{port}/settings
22942024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/hardware/switch-port/{port}/settings
22952024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/switch-port/{port}/status
22962024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/switches
22972024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/switches/{switch_id}
22982024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/identity-providers
22992024-08-16T07:17:51.214ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/identity-providers/local/users
23002024-08-16T07:17:51.215ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/identity-providers/local/users/{user_id}
23012024-08-16T07:17:51.215ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/identity-providers/local/users/{user_id}/set-password
23022024-08-16T07:17:51.215ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/identity-providers/saml
23032024-08-16T07:17:51.215ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/identity-providers/saml/{provider}
23042024-08-16T07:17:51.215ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools
23052024-08-16T07:17:51.215ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools
23062024-08-16T07:17:51.215ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/ip-pools/{pool}
23072024-08-16T07:17:51.215ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools/{pool}
23082024-08-16T07:17:51.215ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/ip-pools/{pool}
23092024-08-16T07:17:51.215ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools/{pool}/ranges
23102024-08-16T07:17:51.215ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools/{pool}/ranges/add
23112024-08-16T07:17:51.215ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools/{pool}/ranges/remove
23122024-08-16T07:17:51.215ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools/{pool}/silos
23132024-08-16T07:17:51.215ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools/{pool}/silos
23142024-08-16T07:17:51.215ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/ip-pools/{pool}/silos/{silo}
23152024-08-16T07:17:51.215ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/ip-pools/{pool}/silos/{silo}
23162024-08-16T07:17:51.215ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools/{pool}/utilization
23172024-08-16T07:17:51.215ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools-service
23182024-08-16T07:17:51.215ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools-service/ranges
23192024-08-16T07:17:51.215ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools-service/ranges/add
23202024-08-16T07:17:51.215ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools-service/ranges/remove
23212024-08-16T07:17:51.215ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/metrics/{metric_name}
23222024-08-16T07:17:51.215ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/address-lot
23232024-08-16T07:17:51.215ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/address-lot
23242024-08-16T07:17:51.215ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/networking/address-lot/{address_lot}
23252024-08-16T07:17:51.215ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/address-lot/{address_lot}/blocks
23262024-08-16T07:17:51.215ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/allow-list
23272024-08-16T07:17:51.215ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/networking/allow-list
23282024-08-16T07:17:51.215ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/bfd-disable
23292024-08-16T07:17:51.215ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/bfd-enable
23302024-08-16T07:17:51.215ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bfd-status
23312024-08-16T07:17:51.215ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/networking/bgp
23322024-08-16T07:17:51.215ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp
23332024-08-16T07:17:51.215ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/bgp
23342024-08-16T07:17:51.215ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/networking/bgp-announce
23352024-08-16T07:17:51.215ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-announce
23362024-08-16T07:17:51.215ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/networking/bgp-announce
23372024-08-16T07:17:51.215ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-message-history
23382024-08-16T07:17:51.215ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-routes-ipv4
23392024-08-16T07:17:51.215ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-status
23402024-08-16T07:17:51.215ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/loopback-address
23412024-08-16T07:17:51.215ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/loopback-address
23422024-08-16T07:17:51.215ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/networking/loopback-address/{rack_id}/{switch_location}/{address}/{subnet_mask}
23432024-08-16T07:17:51.215ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/networking/switch-port-settings
23442024-08-16T07:17:51.215ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/switch-port-settings
23452024-08-16T07:17:51.215ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/switch-port-settings
23462024-08-16T07:17:51.215ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/switch-port-settings/{port}
23472024-08-16T07:17:51.215ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/policy
23482024-08-16T07:17:51.215ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/policy
23492024-08-16T07:17:51.215ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/roles
23502024-08-16T07:17:51.215ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/roles/{role_name}
23512024-08-16T07:17:51.215ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silo-quotas
23522024-08-16T07:17:51.215ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silos
23532024-08-16T07:17:51.215ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/silos
23542024-08-16T07:17:51.215ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/silos/{silo}
23552024-08-16T07:17:51.215ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silos/{silo}
23562024-08-16T07:17:51.215ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silos/{silo}/ip-pools
23572024-08-16T07:17:51.215ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silos/{silo}/policy
23582024-08-16T07:17:51.215ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/silos/{silo}/policy
23592024-08-16T07:17:51.215ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silos/{silo}/quotas
23602024-08-16T07:17:51.215ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/silos/{silo}/quotas
23612024-08-16T07:17:51.215ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/update/repository
23622024-08-16T07:17:51.215ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/update/repository/{system_version}
23632024-08-16T07:17:51.215ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/users
23642024-08-16T07:17:51.215ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/users/{user_id}
23652024-08-16T07:17:51.215ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/users-builtin
23662024-08-16T07:17:51.215ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/users-builtin/{user}
23672024-08-16T07:17:51.215ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/utilization/silos
23682024-08-16T07:17:51.215ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/utilization/silos/{silo}
23692024-08-16T07:17:51.215ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/timeseries/query
23702024-08-16T07:17:51.215ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/timeseries/schema
23712024-08-16T07:17:51.215ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/users
23722024-08-16T07:17:51.215ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/utilization
23732024-08-16T07:17:51.215ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-firewall-rules
23742024-08-16T07:17:51.215ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/vpc-firewall-rules
23752024-08-16T07:17:51.215ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-router-routes
23762024-08-16T07:17:51.215ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/vpc-router-routes
23772024-08-16T07:17:51.215ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/vpc-router-routes/{route}
23782024-08-16T07:17:51.215ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-router-routes/{route}
23792024-08-16T07:17:51.215ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/vpc-router-routes/{route}
23802024-08-16T07:17:51.215ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-routers
23812024-08-16T07:17:51.215ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/vpc-routers
23822024-08-16T07:17:51.215ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/vpc-routers/{router}
23832024-08-16T07:17:51.215ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-routers/{router}
23842024-08-16T07:17:51.215ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/vpc-routers/{router}
23852024-08-16T07:17:51.215ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-subnets
23862024-08-16T07:17:51.215ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/vpc-subnets
23872024-08-16T07:17:51.215ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/vpc-subnets/{subnet}
23882024-08-16T07:17:51.215ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-subnets/{subnet}
23892024-08-16T07:17:51.215ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/vpc-subnets/{subnet}
23902024-08-16T07:17:51.215ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-subnets/{subnet}/network-interfaces
23912024-08-16T07:17:51.215ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpcs
23922024-08-16T07:17:51.215ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/vpcs
23932024-08-16T07:17:51.215ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/vpcs/{vpc}
23942024-08-16T07:17:51.215ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpcs/{vpc}
23952024-08-16T07:17:51.215ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/vpcs/{vpc}
23962024-08-16T07:17:51.215ZINFOnexus (dropshot_external_techport): listening file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:205 local_addr = [fd00:1122:3344:101::c]:12228
23972024-08-16T07:17:51.215ZDEBGnexus (dropshot_external_techport): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::c]:12228
23982024-08-16T07:17:51.217ZDEBGnexus (nexus-producer-server): registered DTrace probes
23992024-08-16T07:17:51.222ZDEBGnexus (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::c]:53719 method = GET path = /{producer_id}
24002024-08-16T07:17:51.222ZINFOnexus (dropshot): listening file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:205 local_addr = [fd00:1122:3344:101::c]:53719
24012024-08-16T07:17:51.222ZDEBGnexus (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::c]:53719
24022024-08-16T07:17:51.222ZDEBGnexus (nexus-producer-server): Requested any available port, Dropshot server has been bound to [fd00:1122:3344:101::c]:53719
24032024-08-16T07:17:51.222ZDEBGnexus (nexus-producer-server): Nexus IP provided explicitly, will use it addr = [fd00:1122:3344:101::c]:12221
24042024-08-16T07:17:51.222ZDEBGnexus (nexus-producer-server): starting producer registration task
24052024-08-16T07:17:51.222ZINFOnexus (nexus-producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::c]:53719 file = oximeter/producer/src/lib.rs:283 interval = 10s producer_id = 0d900881-9285-4dbf-910f-5e4676c8f133
24062024-08-16T07:17:51.222ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
24072024-08-16T07:17:51.222ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
24082024-08-16T07:17:51.229ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
24092024-08-16T07:17:51.229ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "8414fd31-81a3-47d4-a3da-72c1b78edfd4", "content-length": "1", "date": "Fri, 16 Aug 2024 07:17:50 GMT"} })
24102024-08-16T07:17:51.231ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
24112024-08-16T07:17:51.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
24122024-08-16T07:17:51.233ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 376.654179ms iteration = 3 status = null
24132024-08-16T07:17:51.252ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
24142024-08-16T07:17:51.253ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "298cfd08-2d82-4eb8-ae7f-5aee52da6162", "content-length": "691", "date": "Fri, 16 Aug 2024 07:17:51 GMT"} })
24152024-08-16T07:17:51.253ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
24162024-08-16T07:17:51.253ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
24172024-08-16T07:17:51.253ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
24182024-08-16T07:17:51.255ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 391.581084ms iteration = 3 status = {}
24192024-08-16T07:17:51.259ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
24202024-08-16T07:17:51.266ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
24212024-08-16T07:17:51.267ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "ef3d5951-446b-4497-8b52-449ffcbbba55", "date": "Fri, 16 Aug 2024 07:17:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
24222024-08-16T07:17:51.267ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
24232024-08-16T07:17:51.268ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "62ead0b5-143a-472c-95f4-93ef925bd8e0", "date": "Fri, 16 Aug 2024 07:17:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
24242024-08-16T07:17:51.268ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
24252024-08-16T07:17:51.269ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
24262024-08-16T07:17:51.271ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 352.597503ms iteration = 4 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
24272024-08-16T07:17:51.319ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
24282024-08-16T07:17:51.319ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:63151
24292024-08-16T07:17:51.321ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:63151 req_id = c5edf93a-4ee2-46b8-bf04-c78d706887f3 roles = RoleSet { roles: {} } uri = /metrics/producers
24302024-08-16T07:17:51.322ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:63151 req_id = c5edf93a-4ee2-46b8-bf04-c78d706887f3 resource = Database result = Ok(()) uri = /metrics/producers
24312024-08-16T07:17:51.332ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
24322024-08-16T07:17:51.332ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "380df40a-7edb-4468-a94b-1862a00c54ce", "date": "Fri, 16 Aug 2024 07:17:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
24332024-08-16T07:17:51.332ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
24342024-08-16T07:17:51.333ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "fe25cd3e-b90b-445f-aa9b-8e6296b25be3", "date": "Fri, 16 Aug 2024 07:17:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
24352024-08-16T07:17:51.333ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
24362024-08-16T07:17:51.335ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "e628d14a-85e4-4ed4-b548-34e45762f504", "date": "Fri, 16 Aug 2024 07:17:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
24372024-08-16T07:17:51.335ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
24382024-08-16T07:17:51.337ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
24392024-08-16T07:17:51.337ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 408.039034ms iteration = 4 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
24402024-08-16T07:17:51.341ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24412024-08-16T07:17:51.341ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24422024-08-16T07:17:51.342ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:146 port = SwitchPort { id: f13c0939-2c9d-4a0d-b006-5f3de89cc4fc, rack_id: e1b0d583-7b20-4a4b-97f9-9f83300aeb7a, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(4de7fcf8-2b1f-4b0e-ba6f-584e8a34addb) } rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0
24432024-08-16T07:17:51.342ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24442024-08-16T07:17:51.342ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24452024-08-16T07:17:51.349ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
24462024-08-16T07:17:51.349ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b759c353-a208-4885-a3d3-e6dcd8a4ad20", "content-length": "121", "date": "Fri, 16 Aug 2024 07:17:50 GMT"} })
24472024-08-16T07:17:51.349ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1663 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
24482024-08-16T07:17:51.349ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1690 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 4de7fcf8-2b1f-4b0e-ba6f-584e8a34addb
24492024-08-16T07:17:51.350ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None)}}
24502024-08-16T07:17:51.350ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None)}}
24512024-08-16T07:17:51.350ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {}
24522024-08-16T07:17:51.350ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {}
24532024-08-16T07:17:51.350ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
24542024-08-16T07:17:51.350ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24552024-08-16T07:17:51.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24562024-08-16T07:17:51.351ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
24572024-08-16T07:17:51.351ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "caa7eb2f-628f-4097-9ab0-56a7008c4b55", "content-length": "2", "date": "Fri, 16 Aug 2024 07:17:50 GMT"} })
24582024-08-16T07:17:51.351ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
24592024-08-16T07:17:51.351ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "8a617ed8-46b8-4d0c-ab4f-f847a29069c3", "content-length": "52", "date": "Fri, 16 Aug 2024 07:17:50 GMT"} })
24602024-08-16T07:17:51.351ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0
24612024-08-16T07:17:51.351ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
24622024-08-16T07:17:51.358ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 62147b68-6c5f-49df-a144-ebe1b87f0e27
24632024-08-16T07:17:51.358ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:63151 req_id = c5edf93a-4ee2-46b8-bf04-c78d706887f3 roles = RoleSet { roles: {} } uri = /metrics/producers
24642024-08-16T07:17:51.358ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:63151 req_id = c5edf93a-4ee2-46b8-bf04-c78d706887f3 resource = Database result = Ok(()) uri = /metrics/producers
24652024-08-16T07:17:51.411ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "b5fd1385-0ca2-404a-97f1-9b90f935d546", "date": "Fri, 16 Aug 2024 07:17:51 GMT"} })
24662024-08-16T07:17:51.411ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch = Switch0
24672024-08-16T07:17:51.411ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
24682024-08-16T07:17:51.411ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6fd81442-c085-4bb2-aad2-26b99bc49005", "content-length": "494", "date": "Fri, 16 Aug 2024 07:17:51 GMT"} })
24692024-08-16T07:17:51.411ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24702024-08-16T07:17:51.411ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24712024-08-16T07:17:51.414ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24722024-08-16T07:17:51.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24732024-08-16T07:17:51.423ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24742024-08-16T07:17:51.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24752024-08-16T07:17:51.431ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24762024-08-16T07:17:51.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24772024-08-16T07:17:51.465ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 62147b68-6c5f-49df-a144-ebe1b87f0e27 uri = http://[fd00:1122:3344:101::d]:12223/producers
24782024-08-16T07:17:51.466ZDEBGnexus: client response oximeter-collector = 62147b68-6c5f-49df-a144-ebe1b87f0e27 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "457b1383-59db-4320-92b2-ad612e8300cf", "date": "Fri, 16 Aug 2024 07:17:51 GMT"} })
24792024-08-16T07:17:51.466ZINFOnexus: assigned collector to new producer collector_id = 62147b68-6c5f-49df-a144-ebe1b87f0e27 file = nexus/src/app/oximeter.rs:125 producer_id = 0d900881-9285-4dbf-910f-5e4676c8f133
24802024-08-16T07:17:51.468ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 148461 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:63151 req_id = c5edf93a-4ee2-46b8-bf04-c78d706887f3 response_code = 201 uri = /metrics/producers
24812024-08-16T07:17:51.468ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::c)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, status: 201, headers: {"content-type": "application/json", "x-request-id": "c5edf93a-4ee2-46b8-bf04-c78d706887f3", "content-length": "41", "date": "Fri, 16 Aug 2024 07:17:51 GMT"} })
24822024-08-16T07:17:51.469ZDEBGnexus (producer-registration-task): registered with nexus successfully
24832024-08-16T07:17:51.469ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
24842024-08-16T07:17:51.470ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 606.67379ms iteration = 3 status = {}
24852024-08-16T07:17:51.695ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64556 req_id = 350a0462-f4d3-4fb3-837e-7e3a9f6da1e9 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
24862024-08-16T07:17:51.695ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64556 req_id = 350a0462-f4d3-4fb3-837e-7e3a9f6da1e9 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
24872024-08-16T07:17:51.698ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2859 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64556 req_id = 350a0462-f4d3-4fb3-837e-7e3a9f6da1e9 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
24882024-08-16T07:17:51.868ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = c00eec3b-e410-48aa-9cb7-7e81102918c6 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
24892024-08-16T07:17:51.869ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = c00eec3b-e410-48aa-9cb7-7e81102918c6 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
24902024-08-16T07:17:51.870ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1431 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = c00eec3b-e410-48aa-9cb7-7e81102918c6 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
24912024-08-16T07:17:52.889ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 8b4e830e-5804-4e5c-84a2-48c90ee7ff48 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
24922024-08-16T07:17:52.889ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 8b4e830e-5804-4e5c-84a2-48c90ee7ff48 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
24932024-08-16T07:17:52.891ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1769 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 8b4e830e-5804-4e5c-84a2-48c90ee7ff48 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
24942024-08-16T07:17:53.909ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 4a64edfc-83ec-41be-aa5e-65a028fe2df7 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
24952024-08-16T07:17:53.910ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 4a64edfc-83ec-41be-aa5e-65a028fe2df7 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
24962024-08-16T07:17:53.911ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1460 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 4a64edfc-83ec-41be-aa5e-65a028fe2df7 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
24972024-08-16T07:17:54.929ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = d11ce5f0-835b-4d98-87b1-f4fbe198862f roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
24982024-08-16T07:17:54.930ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = d11ce5f0-835b-4d98-87b1-f4fbe198862f resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
24992024-08-16T07:17:54.931ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1637 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = d11ce5f0-835b-4d98-87b1-f4fbe198862f response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
25002024-08-16T07:17:55.953ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = ce89b5f3-36fa-41d9-927f-f7330a793495 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
25012024-08-16T07:17:55.954ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = ce89b5f3-36fa-41d9-927f-f7330a793495 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
25022024-08-16T07:17:55.955ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2086 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = ce89b5f3-36fa-41d9-927f-f7330a793495 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
25032024-08-16T07:17:56.975ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 8736b324-d061-496a-b778-3225107981f5 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
25042024-08-16T07:17:56.975ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 8736b324-d061-496a-b778-3225107981f5 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
25052024-08-16T07:17:56.977ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1872 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 8736b324-d061-496a-b778-3225107981f5 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
25062024-08-16T07:17:57.996ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 29083b9d-7da6-4ee1-bdfd-8800c34443a2 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
25072024-08-16T07:17:57.996ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 29083b9d-7da6-4ee1-bdfd-8800c34443a2 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
25082024-08-16T07:17:57.998ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1563 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 29083b9d-7da6-4ee1-bdfd-8800c34443a2 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
25092024-08-16T07:17:59.017ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 25442e2a-01f8-45d7-ab29-13618fc902be roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
25102024-08-16T07:17:59.018ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 25442e2a-01f8-45d7-ab29-13618fc902be resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
25112024-08-16T07:17:59.019ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1794 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 25442e2a-01f8-45d7-ab29-13618fc902be response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
25122024-08-16T07:18:00.040ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 01d3a1e9-327e-40ea-9381-44c59c1fea48 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
25132024-08-16T07:18:00.040ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 01d3a1e9-327e-40ea-9381-44c59c1fea48 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
25142024-08-16T07:18:00.041ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1628 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 01d3a1e9-327e-40ea-9381-44c59c1fea48 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
25152024-08-16T07:18:00.856ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 8 reason = Timeout
25162024-08-16T07:18:00.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25172024-08-16T07:18:00.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25182024-08-16T07:18:00.858ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25192024-08-16T07:18:00.861ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
25202024-08-16T07:18:00.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25212024-08-16T07:18:00.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25222024-08-16T07:18:00.862ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25232024-08-16T07:18:00.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25242024-08-16T07:18:00.863ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25252024-08-16T07:18:00.863ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 8 reason = Timeout
25262024-08-16T07:18:00.863ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
25272024-08-16T07:18:00.863ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25282024-08-16T07:18:00.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25292024-08-16T07:18:00.865ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25302024-08-16T07:18:00.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25312024-08-16T07:18:00.865ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
25322024-08-16T07:18:00.865ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25332024-08-16T07:18:00.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25342024-08-16T07:18:00.872ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
25352024-08-16T07:18:00.872ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 15.338764ms iteration = 8 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
25362024-08-16T07:18:00.894ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
25372024-08-16T07:18:00.894ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.984415ms iteration = 8 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
25382024-08-16T07:18:01.061ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 58287b69-6c7e-4723-95f7-cba7d5677682 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
25392024-08-16T07:18:01.062ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 58287b69-6c7e-4723-95f7-cba7d5677682 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
25402024-08-16T07:18:01.063ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1816 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 58287b69-6c7e-4723-95f7-cba7d5677682 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
25412024-08-16T07:18:01.505ZINFOnexus (dropshot): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:53719 remote_addr = [fd00:1122:3344:101::d]:60737
25422024-08-16T07:18:01.517ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 12072 local_addr = [fd00:1122:3344:101::c]:53719 method = GET remote_addr = [fd00:1122:3344:101::d]:60737 req_id = b486d1be-a476-46f4-834a-5ada1c63ced0 response_code = 200 uri = /0d900881-9285-4dbf-910f-5e4676c8f133
25432024-08-16T07:18:02.083ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = e36c20b2-8b04-409a-868c-ee0019a424d9 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
25442024-08-16T07:18:02.083ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = e36c20b2-8b04-409a-868c-ee0019a424d9 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
25452024-08-16T07:18:02.084ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2155 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = e36c20b2-8b04-409a-868c-ee0019a424d9 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
25462024-08-16T07:18:03.105ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 8d352c36-1f1a-4e38-bd56-54c19ec6dea1 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
25472024-08-16T07:18:03.105ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 8d352c36-1f1a-4e38-bd56-54c19ec6dea1 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
25482024-08-16T07:18:03.106ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1396 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 8d352c36-1f1a-4e38-bd56-54c19ec6dea1 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
25492024-08-16T07:18:04.125ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 3e1851d5-26e7-45db-8e96-db3034861848 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
25502024-08-16T07:18:04.126ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 3e1851d5-26e7-45db-8e96-db3034861848 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
25512024-08-16T07:18:04.127ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1607 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 3e1851d5-26e7-45db-8e96-db3034861848 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
25522024-08-16T07:18:05.146ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 5e9f1da2-f3f4-45f0-9c63-eaeb06ff3255 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
25532024-08-16T07:18:05.146ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 5e9f1da2-f3f4-45f0-9c63-eaeb06ff3255 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
25542024-08-16T07:18:05.147ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1500 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 5e9f1da2-f3f4-45f0-9c63-eaeb06ff3255 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
25552024-08-16T07:18:06.166ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 886efa2d-9fc8-4128-ad29-182438c957b1 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
25562024-08-16T07:18:06.167ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 886efa2d-9fc8-4128-ad29-182438c957b1 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
25572024-08-16T07:18:06.168ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1713 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 886efa2d-9fc8-4128-ad29-182438c957b1 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
25582024-08-16T07:18:07.187ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = e07b2523-5eaa-4fbf-9f08-d8fe6d1c7d23 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
25592024-08-16T07:18:07.188ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = e07b2523-5eaa-4fbf-9f08-d8fe6d1c7d23 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
25602024-08-16T07:18:07.189ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1643 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = e07b2523-5eaa-4fbf-9f08-d8fe6d1c7d23 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
25612024-08-16T07:18:08.209ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 3c7c04d6-6f6e-4272-a946-e0ff623e268f roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
25622024-08-16T07:18:08.210ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 3c7c04d6-6f6e-4272-a946-e0ff623e268f resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
25632024-08-16T07:18:08.211ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1835 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 3c7c04d6-6f6e-4272-a946-e0ff623e268f response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
25642024-08-16T07:18:09.232ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = a3f38b1f-16c1-4ad9-8ace-8bc9e1931dac roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
25652024-08-16T07:18:09.232ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = a3f38b1f-16c1-4ad9-8ace-8bc9e1931dac resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
25662024-08-16T07:18:09.233ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1659 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = a3f38b1f-16c1-4ad9-8ace-8bc9e1931dac response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
25672024-08-16T07:18:10.252ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 90de4336-32f2-4dba-ac96-50246000cf8f roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
25682024-08-16T07:18:10.252ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 90de4336-32f2-4dba-ac96-50246000cf8f resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
25692024-08-16T07:18:10.253ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1500 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 90de4336-32f2-4dba-ac96-50246000cf8f response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
25702024-08-16T07:18:10.856ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 9 reason = Timeout
25712024-08-16T07:18:10.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25722024-08-16T07:18:10.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25732024-08-16T07:18:10.858ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25742024-08-16T07:18:10.861ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
25752024-08-16T07:18:10.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25762024-08-16T07:18:10.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25772024-08-16T07:18:10.862ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25782024-08-16T07:18:10.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25792024-08-16T07:18:10.863ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 9 reason = Timeout
25802024-08-16T07:18:10.863ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
25812024-08-16T07:18:10.863ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25822024-08-16T07:18:10.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25832024-08-16T07:18:10.863ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25842024-08-16T07:18:10.864ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25852024-08-16T07:18:10.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25862024-08-16T07:18:10.866ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
25872024-08-16T07:18:10.866ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25882024-08-16T07:18:10.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25892024-08-16T07:18:10.866ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
25902024-08-16T07:18:10.866ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.214255ms iteration = 9 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
25912024-08-16T07:18:10.871ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
25922024-08-16T07:18:10.871ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 14.324711ms iteration = 9 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
25932024-08-16T07:18:11.275ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = af673357-21ce-4d95-8152-8428a16312ce roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
25942024-08-16T07:18:11.275ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = af673357-21ce-4d95-8152-8428a16312ce resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
25952024-08-16T07:18:11.277ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2305 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = af673357-21ce-4d95-8152-8428a16312ce response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
25962024-08-16T07:18:11.506ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 585 local_addr = [fd00:1122:3344:101::c]:53719 method = GET remote_addr = [fd00:1122:3344:101::d]:60737 req_id = 09ceae89-7c6e-4339-90f3-dc3554f94e01 response_code = 200 uri = /0d900881-9285-4dbf-910f-5e4676c8f133
25972024-08-16T07:18:12.295ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = bb315124-3304-4f2b-b911-4e24e68ddcb8 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
25982024-08-16T07:18:12.295ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = bb315124-3304-4f2b-b911-4e24e68ddcb8 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
25992024-08-16T07:18:12.297ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1410 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = bb315124-3304-4f2b-b911-4e24e68ddcb8 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
26002024-08-16T07:18:13.315ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = a20b4819-161e-4de6-bfed-d9ecb8b59332 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
26012024-08-16T07:18:13.316ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = a20b4819-161e-4de6-bfed-d9ecb8b59332 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
26022024-08-16T07:18:13.317ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1342 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = a20b4819-161e-4de6-bfed-d9ecb8b59332 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
26032024-08-16T07:18:14.335ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = cd7c96b1-bf8a-4530-ae2d-d06efa6db2e9 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
26042024-08-16T07:18:14.336ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = cd7c96b1-bf8a-4530-ae2d-d06efa6db2e9 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
26052024-08-16T07:18:14.337ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1723 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = cd7c96b1-bf8a-4530-ae2d-d06efa6db2e9 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
26062024-08-16T07:18:15.356ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 5a93670d-1944-4241-b5ab-83069782183a roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
26072024-08-16T07:18:15.356ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 5a93670d-1944-4241-b5ab-83069782183a resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
26082024-08-16T07:18:15.358ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1469 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 5a93670d-1944-4241-b5ab-83069782183a response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
26092024-08-16T07:18:16.378ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = b63cee69-195d-4d44-b778-973724f0ac83 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
26102024-08-16T07:18:16.378ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = b63cee69-195d-4d44-b778-973724f0ac83 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
26112024-08-16T07:18:16.379ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1581 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = b63cee69-195d-4d44-b778-973724f0ac83 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
26122024-08-16T07:18:17.398ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 499eba6c-601a-4b80-bad1-3830ea68ddb9 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
26132024-08-16T07:18:17.398ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 499eba6c-601a-4b80-bad1-3830ea68ddb9 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
26142024-08-16T07:18:17.399ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1387 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 499eba6c-601a-4b80-bad1-3830ea68ddb9 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
26152024-08-16T07:18:18.417ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 8bdace13-29da-47ed-85b2-da4956346078 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
26162024-08-16T07:18:18.417ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 8bdace13-29da-47ed-85b2-da4956346078 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
26172024-08-16T07:18:18.418ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1430 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 8bdace13-29da-47ed-85b2-da4956346078 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
26182024-08-16T07:18:19.439ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 6ffa608f-0723-40cb-a50f-d05b57762d42 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
26192024-08-16T07:18:19.439ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 6ffa608f-0723-40cb-a50f-d05b57762d42 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
26202024-08-16T07:18:19.440ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1621 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 6ffa608f-0723-40cb-a50f-d05b57762d42 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
26212024-08-16T07:18:20.459ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 8d265ab5-b886-44d8-9de3-d3753a0e3496 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
26222024-08-16T07:18:20.459ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 8d265ab5-b886-44d8-9de3-d3753a0e3496 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
26232024-08-16T07:18:20.460ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1697 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 8d265ab5-b886-44d8-9de3-d3753a0e3496 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
26242024-08-16T07:18:20.856ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 4 reason = Timeout
26252024-08-16T07:18:20.857ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 4 reason = Timeout
26262024-08-16T07:18:20.857ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
26272024-08-16T07:18:20.857ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
26282024-08-16T07:18:20.857ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 4 reason = Timeout
26292024-08-16T07:18:20.857ZWARNnexus (BackgroundTasks): phantom disk task started background_task = phantom_disks file = nexus/src/app/background/tasks/phantom_disks.rs:46
26302024-08-16T07:18:20.857ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 10 reason = Timeout
26312024-08-16T07:18:20.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26322024-08-16T07:18:20.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
26332024-08-16T07:18:20.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
26342024-08-16T07:18:20.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26352024-08-16T07:18:20.858ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 6 reason = Timeout
26362024-08-16T07:18:20.858ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
26372024-08-16T07:18:20.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
26382024-08-16T07:18:20.858ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26392024-08-16T07:18:20.859ZWARNnexus (BackgroundTasks): phantom disk task done background_task = phantom_disks file = nexus/src/app/background/tasks/phantom_disks.rs:93
26402024-08-16T07:18:20.859ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.174051ms iteration = 4 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
26412024-08-16T07:18:20.859ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1164, tv_nsec: 235103844 } })
26422024-08-16T07:18:20.859ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26432024-08-16T07:18:20.860ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
26442024-08-16T07:18:20.861ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
26452024-08-16T07:18:20.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26462024-08-16T07:18:20.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26472024-08-16T07:18:20.862ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
26482024-08-16T07:18:20.862ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
26492024-08-16T07:18:20.862ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1164, tv_nsec: 237666903 } })
26502024-08-16T07:18:20.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
26512024-08-16T07:18:20.863ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 4 reason = Timeout
26522024-08-16T07:18:20.863ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 4 reason = Timeout
26532024-08-16T07:18:20.863ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
26542024-08-16T07:18:20.863ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 4 reason = Timeout
26552024-08-16T07:18:20.863ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
26562024-08-16T07:18:20.863ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26572024-08-16T07:18:20.863ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26582024-08-16T07:18:20.863ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 10 reason = Timeout
26592024-08-16T07:18:20.863ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
26602024-08-16T07:18:20.863ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26612024-08-16T07:18:20.863ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 4 reason = Timeout
26622024-08-16T07:18:20.863ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26632024-08-16T07:18:20.863ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 4 reason = Timeout
26642024-08-16T07:18:20.863ZINFOnexus (BackgroundTasks): region snapshot replacement garbage collect task started background_task = region_snapshot_replacement_garbage_collection file = nexus/src/app/background/tasks/region_snapshot_replacement_garbage_collect.rs:133
26652024-08-16T07:18:20.863ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
26662024-08-16T07:18:20.863ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 4 reason = Timeout
26672024-08-16T07:18:20.863ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
26682024-08-16T07:18:20.863ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26692024-08-16T07:18:20.863ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 4 reason = Timeout
26702024-08-16T07:18:20.863ZWARNnexus (BackgroundTasks): region replacement task started background_task = region_replacement file = nexus/src/app/background/tasks/region_replacement.rs:64
26712024-08-16T07:18:20.863ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
26722024-08-16T07:18:20.863ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 4 reason = Timeout
26732024-08-16T07:18:20.863ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
26742024-08-16T07:18:20.863ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 4 reason = Timeout
26752024-08-16T07:18:20.863ZINFOnexus (BackgroundTasks): region snapshot replacement start task started background_task = region_snapshot_replacement_start file = nexus/src/app/background/tasks/region_snapshot_replacement_start.rs:236
26762024-08-16T07:18:20.863ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
26772024-08-16T07:18:20.863ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
26782024-08-16T07:18:20.863ZWARNnexus (BackgroundTasks): physical disk adoption task started background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:100
26792024-08-16T07:18:20.863ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
26802024-08-16T07:18:20.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26812024-08-16T07:18:20.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26822024-08-16T07:18:20.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
26832024-08-16T07:18:20.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26842024-08-16T07:18:20.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
26852024-08-16T07:18:20.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
26862024-08-16T07:18:20.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26872024-08-16T07:18:20.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26882024-08-16T07:18:20.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
26892024-08-16T07:18:20.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
26902024-08-16T07:18:20.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
26912024-08-16T07:18:20.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
26922024-08-16T07:18:20.864ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26932024-08-16T07:18:20.865ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26942024-08-16T07:18:20.865ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26952024-08-16T07:18:20.865ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26962024-08-16T07:18:20.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26972024-08-16T07:18:20.865ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26982024-08-16T07:18:20.865ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26992024-08-16T07:18:20.865ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
27002024-08-16T07:18:20.865ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
27012024-08-16T07:18:20.865ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
27022024-08-16T07:18:20.866ZINFOnexus (BackgroundTasks): region snapshot replacement garbage collect task done background_task = region_snapshot_replacement_garbage_collection file = nexus/src/app/background/tasks/region_snapshot_replacement_garbage_collect.rs:147
27032024-08-16T07:18:20.866ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 2.888067ms iteration = 4 status = {"errors":[],"garbage_collect_requested":[]}
27042024-08-16T07:18:20.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
27052024-08-16T07:18:20.866ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27062024-08-16T07:18:20.866ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
27072024-08-16T07:18:20.866ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.506711ms iteration = 10 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
27082024-08-16T07:18:20.867ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
27092024-08-16T07:18:20.867ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27102024-08-16T07:18:20.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27112024-08-16T07:18:20.868ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
27122024-08-16T07:18:20.868ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
27132024-08-16T07:18:20.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
27142024-08-16T07:18:20.869ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1164, tv_nsec: 244631734 } })
27152024-08-16T07:18:20.869ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
27162024-08-16T07:18:20.869ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27172024-08-16T07:18:20.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27182024-08-16T07:18:20.869ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
27192024-08-16T07:18:20.869ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27202024-08-16T07:18:20.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27212024-08-16T07:18:20.869ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
27222024-08-16T07:18:20.869ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
27232024-08-16T07:18:20.870ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27242024-08-16T07:18:20.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27252024-08-16T07:18:20.870ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27262024-08-16T07:18:20.870ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
27272024-08-16T07:18:20.870ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
27282024-08-16T07:18:20.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
27292024-08-16T07:18:20.871ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
27302024-08-16T07:18:20.871ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27312024-08-16T07:18:20.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27322024-08-16T07:18:20.872ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
27332024-08-16T07:18:20.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
27342024-08-16T07:18:20.873ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
27352024-08-16T07:18:20.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
27362024-08-16T07:18:20.878ZWARNnexus (BackgroundTasks): region replacement task done background_task = region_replacement file = nexus/src/app/background/tasks/region_replacement.rs:185
27372024-08-16T07:18:20.878ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 14.959045ms iteration = 4 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
27382024-08-16T07:18:20.878ZINFOnexus (BackgroundTasks): region snapshot replacement start task done background_task = region_snapshot_replacement_start file = nexus/src/app/background/tasks/region_snapshot_replacement_start.rs:252
27392024-08-16T07:18:20.878ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 14.970466ms iteration = 4 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
27402024-08-16T07:18:20.879ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
27412024-08-16T07:18:20.879ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 15.724193ms iteration = 4 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
27422024-08-16T07:18:20.881ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27432024-08-16T07:18:20.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27442024-08-16T07:18:20.887ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
27452024-08-16T07:18:20.887ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 30.440453ms iteration = 10 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
27462024-08-16T07:18:20.901ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27472024-08-16T07:18:20.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27482024-08-16T07:18:20.902ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
27492024-08-16T07:18:20.902ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
27502024-08-16T07:18:20.902ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 39.433521ms iteration = 4 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
27512024-08-16T07:18:20.902ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27522024-08-16T07:18:20.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27532024-08-16T07:18:20.903ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27542024-08-16T07:18:20.905ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae, lookup_type: ById(03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae) } result = Ok(())
27552024-08-16T07:18:20.905ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27562024-08-16T07:18:20.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27572024-08-16T07:18:20.907ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 43.972686ms iteration = 4 status = 0
27582024-08-16T07:18:20.910ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
27592024-08-16T07:18:20.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
27602024-08-16T07:18:20.912ZWARNnexus (BackgroundTasks): physical disk adoption task done background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:174
27612024-08-16T07:18:20.912ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 54.321574ms iteration = 6 status = {"physical_disks_added":0}
27622024-08-16T07:18:20.917ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
27632024-08-16T07:18:20.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
27642024-08-16T07:18:20.918ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27652024-08-16T07:18:20.920ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
27662024-08-16T07:18:20.920ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
27672024-08-16T07:18:20.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
27682024-08-16T07:18:20.921ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27692024-08-16T07:18:20.922ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
27702024-08-16T07:18:20.922ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
27712024-08-16T07:18:20.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
27722024-08-16T07:18:20.957ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
27732024-08-16T07:18:20.957ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
27742024-08-16T07:18:20.957ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6ee07597-26bf-4652-8025-03b044704864", "content-length": "26", "date": "Fri, 16 Aug 2024 07:18:20 GMT"} })
27752024-08-16T07:18:20.957ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
27762024-08-16T07:18:20.959ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
27772024-08-16T07:18:20.972ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
27782024-08-16T07:18:20.972ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
27792024-08-16T07:18:20.973ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "5b80d9d8-3a3d-4c77-8bde-a2b2d7418fd5", "content-length": "26", "date": "Fri, 16 Aug 2024 07:18:20 GMT"} })
27802024-08-16T07:18:20.973ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
27812024-08-16T07:18:20.974ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
27822024-08-16T07:18:20.991ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
27832024-08-16T07:18:20.992ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e5525db3-396b-4d09-bdb2-834a03a47fb2", "content-length": "372", "date": "Fri, 16 Aug 2024 07:18:20 GMT"} })
27842024-08-16T07:18:20.992ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27852024-08-16T07:18:20.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27862024-08-16T07:18:20.993ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27872024-08-16T07:18:20.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27882024-08-16T07:18:20.996ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27892024-08-16T07:18:20.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27902024-08-16T07:18:20.999ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
27912024-08-16T07:18:20.999ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "e4036f82-d19e-4561-be07-7cc8c6d6bcaf", "date": "Fri, 16 Aug 2024 07:18:20 GMT"} })
27922024-08-16T07:18:21.001ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 138.025628ms iteration = 4 status = {}
27932024-08-16T07:18:21.037ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a zone_address = fd00:1122:3344:101::2
27942024-08-16T07:18:21.037ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
27952024-08-16T07:18:21.037ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "777f17bd-a539-4166-96e6-78d35c5c887d", "content-length": "26", "date": "Fri, 16 Aug 2024 07:18:20 GMT"} })
27962024-08-16T07:18:21.037ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
27972024-08-16T07:18:21.039ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
27982024-08-16T07:18:21.079ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
27992024-08-16T07:18:21.079ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "bc15590b-e404-4228-af15-76bbc1b0107e", "content-length": "1", "date": "Fri, 16 Aug 2024 07:18:20 GMT"} })
28002024-08-16T07:18:21.080ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
28012024-08-16T07:18:21.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
28022024-08-16T07:18:21.082ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 225.653911ms iteration = 4 status = null
28032024-08-16T07:18:21.087ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 230.984924ms iteration = 4 status = {}
28042024-08-16T07:18:21.090ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
28052024-08-16T07:18:21.090ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d597c426-9ebb-4a67-845c-1c542b3a0ec6", "content-length": "691", "date": "Fri, 16 Aug 2024 07:18:20 GMT"} })
28062024-08-16T07:18:21.090ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
28072024-08-16T07:18:21.090ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
28082024-08-16T07:18:21.090ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
28092024-08-16T07:18:21.092ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 229.317356ms iteration = 4 status = {}
28102024-08-16T07:18:21.164ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28112024-08-16T07:18:21.165ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28122024-08-16T07:18:21.166ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:146 port = SwitchPort { id: f13c0939-2c9d-4a0d-b006-5f3de89cc4fc, rack_id: e1b0d583-7b20-4a4b-97f9-9f83300aeb7a, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(4de7fcf8-2b1f-4b0e-ba6f-584e8a34addb) } rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0
28132024-08-16T07:18:21.166ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28142024-08-16T07:18:21.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28152024-08-16T07:18:21.173ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
28162024-08-16T07:18:21.173ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b2d85fa7-235b-4ca9-b4ab-b8e1935ad43d", "content-length": "121", "date": "Fri, 16 Aug 2024 07:18:20 GMT"} })
28172024-08-16T07:18:21.173ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1663 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
28182024-08-16T07:18:21.173ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1690 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 4de7fcf8-2b1f-4b0e-ba6f-584e8a34addb
28192024-08-16T07:18:21.173ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None)}}
28202024-08-16T07:18:21.173ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None)}}
28212024-08-16T07:18:21.173ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {}
28222024-08-16T07:18:21.173ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {}
28232024-08-16T07:18:21.173ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
28242024-08-16T07:18:21.173ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28252024-08-16T07:18:21.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28262024-08-16T07:18:21.174ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
28272024-08-16T07:18:21.174ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "5b5134e6-840d-46dd-ab23-d6edeca06b2a", "content-length": "2", "date": "Fri, 16 Aug 2024 07:18:20 GMT"} })
28282024-08-16T07:18:21.174ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
28292024-08-16T07:18:21.175ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ace62e16-3c51-4b43-8af0-e80423f9f052", "content-length": "52", "date": "Fri, 16 Aug 2024 07:18:20 GMT"} })
28302024-08-16T07:18:21.175ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0
28312024-08-16T07:18:21.175ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
28322024-08-16T07:18:21.228ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "19c65fb5-c22f-45f3-a6b2-03e40c7c683b", "date": "Fri, 16 Aug 2024 07:18:20 GMT"} })
28332024-08-16T07:18:21.228ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch = Switch0
28342024-08-16T07:18:21.228ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
28352024-08-16T07:18:21.229ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "06263f02-92e7-4139-b420-a04f9ff9ad9a", "content-length": "494", "date": "Fri, 16 Aug 2024 07:18:20 GMT"} })
28362024-08-16T07:18:21.229ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28372024-08-16T07:18:21.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28382024-08-16T07:18:21.231ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28392024-08-16T07:18:21.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28402024-08-16T07:18:21.234ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28412024-08-16T07:18:21.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28422024-08-16T07:18:21.235ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28432024-08-16T07:18:21.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28442024-08-16T07:18:21.242ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 378.906571ms iteration = 4 status = {}
28452024-08-16T07:18:21.481ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 26b66aaf-7268-4e17-bda4-090f56636cbd roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
28462024-08-16T07:18:21.481ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 26b66aaf-7268-4e17-bda4-090f56636cbd resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
28472024-08-16T07:18:21.482ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1418 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 26b66aaf-7268-4e17-bda4-090f56636cbd response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
28482024-08-16T07:18:21.505ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 619 local_addr = [fd00:1122:3344:101::c]:53719 method = GET remote_addr = [fd00:1122:3344:101::d]:60737 req_id = 0b9004fc-5c5c-4123-92e8-e869896338bd response_code = 200 uri = /0d900881-9285-4dbf-910f-5e4676c8f133
28492024-08-16T07:18:21.729ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64556 req_id = 8ebbdc93-a501-4958-8faf-b80a68e34cc2 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
28502024-08-16T07:18:21.729ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64556 req_id = 8ebbdc93-a501-4958-8faf-b80a68e34cc2 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
28512024-08-16T07:18:21.731ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2538 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64556 req_id = 8ebbdc93-a501-4958-8faf-b80a68e34cc2 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
28522024-08-16T07:18:22.501ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = baa37b4d-674b-4ee4-a870-9395fd591433 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
28532024-08-16T07:18:22.502ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = baa37b4d-674b-4ee4-a870-9395fd591433 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
28542024-08-16T07:18:22.503ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1466 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = baa37b4d-674b-4ee4-a870-9395fd591433 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
28552024-08-16T07:18:23.523ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = b012193c-5d9c-4ec4-934b-056bc7136ef7 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
28562024-08-16T07:18:23.523ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = b012193c-5d9c-4ec4-934b-056bc7136ef7 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
28572024-08-16T07:18:23.524ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1486 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = b012193c-5d9c-4ec4-934b-056bc7136ef7 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
28582024-08-16T07:18:24.545ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 768f8b93-bb1f-4e75-adb1-99d674749dce roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
28592024-08-16T07:18:24.545ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 768f8b93-bb1f-4e75-adb1-99d674749dce resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
28602024-08-16T07:18:24.546ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1643 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 768f8b93-bb1f-4e75-adb1-99d674749dce response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
28612024-08-16T07:18:25.566ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 60458936-d7a9-4ee0-a66e-694125d0431f roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
28622024-08-16T07:18:25.566ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 60458936-d7a9-4ee0-a66e-694125d0431f resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
28632024-08-16T07:18:25.567ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1551 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 60458936-d7a9-4ee0-a66e-694125d0431f response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
28642024-08-16T07:18:26.587ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = cacccde2-635f-48bd-bb45-534c0d690d98 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
28652024-08-16T07:18:26.587ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = cacccde2-635f-48bd-bb45-534c0d690d98 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
28662024-08-16T07:18:26.588ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2051 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = cacccde2-635f-48bd-bb45-534c0d690d98 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
28672024-08-16T07:18:27.607ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 3a82ad5b-5c1d-4bee-b012-00fc0eadf194 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
28682024-08-16T07:18:27.608ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 3a82ad5b-5c1d-4bee-b012-00fc0eadf194 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
28692024-08-16T07:18:27.609ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1840 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 3a82ad5b-5c1d-4bee-b012-00fc0eadf194 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
28702024-08-16T07:18:28.629ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 67d61e6c-6ece-42bd-b13a-957efe8f8ed4 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
28712024-08-16T07:18:28.629ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 67d61e6c-6ece-42bd-b13a-957efe8f8ed4 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
28722024-08-16T07:18:28.630ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1631 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 67d61e6c-6ece-42bd-b13a-957efe8f8ed4 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
28732024-08-16T07:18:29.649ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 03d83b05-2244-48f9-a07f-2cc3dce30b9f roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
28742024-08-16T07:18:29.650ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 03d83b05-2244-48f9-a07f-2cc3dce30b9f resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
28752024-08-16T07:18:29.651ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1782 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 03d83b05-2244-48f9-a07f-2cc3dce30b9f response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
28762024-08-16T07:18:30.670ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 05a25b16-b680-4437-91ed-3e04a7539ce9 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
28772024-08-16T07:18:30.671ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 05a25b16-b680-4437-91ed-3e04a7539ce9 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
28782024-08-16T07:18:30.672ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1474 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 05a25b16-b680-4437-91ed-3e04a7539ce9 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
28792024-08-16T07:18:30.857ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 11 reason = Timeout
28802024-08-16T07:18:30.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28812024-08-16T07:18:30.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28822024-08-16T07:18:30.858ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28832024-08-16T07:18:30.861ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
28842024-08-16T07:18:30.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28852024-08-16T07:18:30.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28862024-08-16T07:18:30.862ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28872024-08-16T07:18:30.862ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 11 reason = Timeout
28882024-08-16T07:18:30.862ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
28892024-08-16T07:18:30.862ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28902024-08-16T07:18:30.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28912024-08-16T07:18:30.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28922024-08-16T07:18:30.864ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28932024-08-16T07:18:30.864ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28942024-08-16T07:18:30.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28952024-08-16T07:18:30.866ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
28962024-08-16T07:18:30.866ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.45063ms iteration = 11 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
28972024-08-16T07:18:30.866ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
28982024-08-16T07:18:30.866ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28992024-08-16T07:18:30.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29002024-08-16T07:18:30.873ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
29012024-08-16T07:18:30.873ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 16.133202ms iteration = 11 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
29022024-08-16T07:18:31.506ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1012 local_addr = [fd00:1122:3344:101::c]:53719 method = GET remote_addr = [fd00:1122:3344:101::d]:60737 req_id = ede31956-61e5-4a7a-b429-d012adcdb681 response_code = 200 uri = /0d900881-9285-4dbf-910f-5e4676c8f133
29032024-08-16T07:18:31.691ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = d19c113e-3587-4fa3-8537-f64aed538a25 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
29042024-08-16T07:18:31.692ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = d19c113e-3587-4fa3-8537-f64aed538a25 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
29052024-08-16T07:18:31.693ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1852 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = d19c113e-3587-4fa3-8537-f64aed538a25 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
29062024-08-16T07:18:32.712ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 8462465f-9f0e-4dde-94f9-7b0e68764b5c roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
29072024-08-16T07:18:32.713ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 8462465f-9f0e-4dde-94f9-7b0e68764b5c resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
29082024-08-16T07:18:32.714ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1487 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 8462465f-9f0e-4dde-94f9-7b0e68764b5c response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
29092024-08-16T07:18:33.733ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = a0c55c6b-81c7-4e7b-9c10-9f238a7a69b5 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
29102024-08-16T07:18:33.733ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = a0c55c6b-81c7-4e7b-9c10-9f238a7a69b5 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
29112024-08-16T07:18:33.734ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1746 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = a0c55c6b-81c7-4e7b-9c10-9f238a7a69b5 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
29122024-08-16T07:18:34.755ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 747e3d06-9aad-420a-bbb5-ff2e8dfcca8e roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
29132024-08-16T07:18:34.755ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 747e3d06-9aad-420a-bbb5-ff2e8dfcca8e resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
29142024-08-16T07:18:34.757ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1766 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 747e3d06-9aad-420a-bbb5-ff2e8dfcca8e response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
29152024-08-16T07:18:35.777ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 321d2c9c-bded-4bba-bfd9-9bc253f716cb roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
29162024-08-16T07:18:35.777ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 321d2c9c-bded-4bba-bfd9-9bc253f716cb resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
29172024-08-16T07:18:35.779ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1885 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 321d2c9c-bded-4bba-bfd9-9bc253f716cb response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
29182024-08-16T07:18:36.798ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 2ff78352-f8c1-4ea1-a1b3-9a5161284665 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
29192024-08-16T07:18:36.799ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 2ff78352-f8c1-4ea1-a1b3-9a5161284665 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
29202024-08-16T07:18:36.800ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2151 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 2ff78352-f8c1-4ea1-a1b3-9a5161284665 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
29212024-08-16T07:18:37.819ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 4d8a3482-010c-4957-9f0f-43e8e46bf3d5 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
29222024-08-16T07:18:37.819ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 4d8a3482-010c-4957-9f0f-43e8e46bf3d5 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
29232024-08-16T07:18:37.821ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2287 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 4d8a3482-010c-4957-9f0f-43e8e46bf3d5 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
29242024-08-16T07:18:38.840ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 72d5ff4a-e2e9-4061-8415-f931ac0f0c99 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
29252024-08-16T07:18:38.840ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 72d5ff4a-e2e9-4061-8415-f931ac0f0c99 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
29262024-08-16T07:18:38.842ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2413 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 72d5ff4a-e2e9-4061-8415-f931ac0f0c99 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
29272024-08-16T07:18:39.862ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 6827dec1-7b7c-4206-8279-cc081aab7d71 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
29282024-08-16T07:18:39.863ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 6827dec1-7b7c-4206-8279-cc081aab7d71 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
29292024-08-16T07:18:39.864ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1794 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 6827dec1-7b7c-4206-8279-cc081aab7d71 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
29302024-08-16T07:18:40.856ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 12 reason = Timeout
29312024-08-16T07:18:40.856ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29322024-08-16T07:18:40.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29332024-08-16T07:18:40.858ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29342024-08-16T07:18:40.860ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
29352024-08-16T07:18:40.860ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29362024-08-16T07:18:40.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29372024-08-16T07:18:40.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29382024-08-16T07:18:40.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29392024-08-16T07:18:40.863ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29402024-08-16T07:18:40.863ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 12 reason = Timeout
29412024-08-16T07:18:40.863ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
29422024-08-16T07:18:40.863ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29432024-08-16T07:18:40.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29442024-08-16T07:18:40.864ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29452024-08-16T07:18:40.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29462024-08-16T07:18:40.865ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
29472024-08-16T07:18:40.865ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29482024-08-16T07:18:40.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29492024-08-16T07:18:40.866ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
29502024-08-16T07:18:40.866ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.027ms iteration = 12 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
29512024-08-16T07:18:40.870ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
29522024-08-16T07:18:40.870ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 13.905551ms iteration = 12 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
29532024-08-16T07:18:40.886ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = f510aad6-e4d6-48d2-97df-1d8fb0e841f3 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
29542024-08-16T07:18:40.886ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = f510aad6-e4d6-48d2-97df-1d8fb0e841f3 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
29552024-08-16T07:18:40.887ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1505 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = f510aad6-e4d6-48d2-97df-1d8fb0e841f3 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
29562024-08-16T07:18:41.505ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 646 local_addr = [fd00:1122:3344:101::c]:53719 method = GET remote_addr = [fd00:1122:3344:101::d]:60737 req_id = 77c9a3c0-71c2-49fe-9ea4-de485ec4820e response_code = 200 uri = /0d900881-9285-4dbf-910f-5e4676c8f133
29572024-08-16T07:18:41.905ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = f2ad39f0-7334-4764-92ea-adef7891d377 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
29582024-08-16T07:18:41.906ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = f2ad39f0-7334-4764-92ea-adef7891d377 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
29592024-08-16T07:18:41.907ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1983 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = f2ad39f0-7334-4764-92ea-adef7891d377 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
29602024-08-16T07:18:42.926ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 78ab4653-4111-4594-965f-40ff7f995b92 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
29612024-08-16T07:18:42.926ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 78ab4653-4111-4594-965f-40ff7f995b92 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
29622024-08-16T07:18:42.928ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2112 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 78ab4653-4111-4594-965f-40ff7f995b92 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
29632024-08-16T07:18:43.948ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 6a644305-fad2-414c-b27f-fae5738dbc53 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
29642024-08-16T07:18:43.948ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 6a644305-fad2-414c-b27f-fae5738dbc53 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
29652024-08-16T07:18:43.949ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2066 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 6a644305-fad2-414c-b27f-fae5738dbc53 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
29662024-08-16T07:18:44.969ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 4defdc11-570d-4736-aedf-54f4176c9b54 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
29672024-08-16T07:18:44.969ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 4defdc11-570d-4736-aedf-54f4176c9b54 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
29682024-08-16T07:18:44.971ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2359 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 4defdc11-570d-4736-aedf-54f4176c9b54 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
29692024-08-16T07:18:45.991ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 7ab82aa1-f9da-4a6f-87b3-292a138750ba roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
29702024-08-16T07:18:45.992ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 7ab82aa1-f9da-4a6f-87b3-292a138750ba resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
29712024-08-16T07:18:45.993ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2051 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 7ab82aa1-f9da-4a6f-87b3-292a138750ba response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
29722024-08-16T07:18:47.013ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = fd37c329-2b16-4ebc-a9c8-0d3fb3d3bf7e roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
29732024-08-16T07:18:47.013ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = fd37c329-2b16-4ebc-a9c8-0d3fb3d3bf7e resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
29742024-08-16T07:18:47.015ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2536 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = fd37c329-2b16-4ebc-a9c8-0d3fb3d3bf7e response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
29752024-08-16T07:18:48.036ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 6fef5b28-3235-43f1-ac03-14dff2abf31b roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
29762024-08-16T07:18:48.036ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 6fef5b28-3235-43f1-ac03-14dff2abf31b resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
29772024-08-16T07:18:48.038ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2824 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 6fef5b28-3235-43f1-ac03-14dff2abf31b response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
29782024-08-16T07:18:49.059ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = c895294d-2579-497b-a4f2-7279d4426ab0 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
29792024-08-16T07:18:49.059ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = c895294d-2579-497b-a4f2-7279d4426ab0 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
29802024-08-16T07:18:49.061ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1920 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = c895294d-2579-497b-a4f2-7279d4426ab0 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
29812024-08-16T07:18:50.080ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 592a5f9f-c8bb-40ca-86bd-3b26b19ea774 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
29822024-08-16T07:18:50.081ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 592a5f9f-c8bb-40ca-86bd-3b26b19ea774 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
29832024-08-16T07:18:50.083ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2264 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 592a5f9f-c8bb-40ca-86bd-3b26b19ea774 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
29842024-08-16T07:18:50.857ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 3 reason = Timeout
29852024-08-16T07:18:50.857ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 13 reason = Timeout
29862024-08-16T07:18:50.857ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
29872024-08-16T07:18:50.857ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
29882024-08-16T07:18:50.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29892024-08-16T07:18:50.857ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 3 reason = Timeout
29902024-08-16T07:18:50.857ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 4 reason = Timeout
29912024-08-16T07:18:50.857ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:69 reason = blueprint disabled target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d
29922024-08-16T07:18:50.857ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.27\u{b5}s iteration = 4 status = {"error":"blueprint disabled","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d"}
29932024-08-16T07:18:50.857ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 5 reason = Timeout
29942024-08-16T07:18:50.857ZWARNnexus (BackgroundTasks): phantom disk task started background_task = phantom_disks file = nexus/src/app/background/tasks/phantom_disks.rs:46
29952024-08-16T07:18:50.857ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 3 reason = Timeout
29962024-08-16T07:18:50.857ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 3 reason = Timeout
29972024-08-16T07:18:50.857ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-08-16 07:08:50.857257671 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
29982024-08-16T07:18:50.857ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 3 reason = Timeout
29992024-08-16T07:18:50.857ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
30002024-08-16T07:18:50.857ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
30012024-08-16T07:18:50.857ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
30022024-08-16T07:18:50.857ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
30032024-08-16T07:18:50.857ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 3 reason = Timeout
30042024-08-16T07:18:50.857ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 5 reason = Timeout
30052024-08-16T07:18:50.857ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
30062024-08-16T07:18:50.857ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 5 reason = Timeout
30072024-08-16T07:18:50.857ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 5 reason = Timeout
30082024-08-16T07:18:50.857ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
30092024-08-16T07:18:50.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30102024-08-16T07:18:50.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
30112024-08-16T07:18:50.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
30122024-08-16T07:18:50.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
30132024-08-16T07:18:50.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
30142024-08-16T07:18:50.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
30152024-08-16T07:18:50.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
30162024-08-16T07:18:50.857ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 3 reason = Timeout
30172024-08-16T07:18:50.857ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
30182024-08-16T07:18:50.857ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 7 reason = Timeout
30192024-08-16T07:18:50.857ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
30202024-08-16T07:18:50.857ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
30212024-08-16T07:18:50.857ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6d6264ea-5d56-4938-8c26-581ed0b9907b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a8440aa3-608b-4c08-b70c-6d92a9461396.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("aea2243f-052e-4953-bdfa-7c3368895dd2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("aea2243f-052e-4953-bdfa-7c3368895dd2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1194, tv_nsec: 233667204 } })
30222024-08-16T07:18:50.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
30232024-08-16T07:18:50.858ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("dec19c15-1a2d-47ac-9b9e-9f424d3a3464.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f9649eef-936b-4765-9810-da8662275db5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f9649eef-936b-4765-9810-da8662275db5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1194, tv_nsec: 233797578 } })
30242024-08-16T07:18:50.858ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
30252024-08-16T07:18:50.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
30262024-08-16T07:18:50.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
30272024-08-16T07:18:50.859ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
30282024-08-16T07:18:50.859ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 2.18559ms iteration = 3 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
30292024-08-16T07:18:50.859ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30302024-08-16T07:18:50.859ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
30312024-08-16T07:18:50.860ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30322024-08-16T07:18:50.860ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
30332024-08-16T07:18:50.860ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 2.908937ms iteration = 3 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
30342024-08-16T07:18:50.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
30352024-08-16T07:18:50.860ZWARNnexus (BackgroundTasks): phantom disk task done background_task = phantom_disks file = nexus/src/app/background/tasks/phantom_disks.rs:93
30362024-08-16T07:18:50.860ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.03069ms iteration = 5 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
30372024-08-16T07:18:50.860ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30382024-08-16T07:18:50.860ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1194, tv_nsec: 236715945 } })
30392024-08-16T07:18:50.861ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1194, tv_nsec: 236771956 } })
30402024-08-16T07:18:50.861ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30412024-08-16T07:18:50.861ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-08-16 07:08:50.857257671 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
30422024-08-16T07:18:50.861ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.995833ms iteration = 3 status = {"expiration":"2024-08-16T07:08:50.857257671Z","pruned":[]}
30432024-08-16T07:18:50.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30442024-08-16T07:18:50.861ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
30452024-08-16T07:18:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
30462024-08-16T07:18:50.862ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
30472024-08-16T07:18:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
30482024-08-16T07:18:50.863ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 5 reason = Timeout
30492024-08-16T07:18:50.863ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 5 reason = Timeout
30502024-08-16T07:18:50.863ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30512024-08-16T07:18:50.863ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30522024-08-16T07:18:50.863ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 5 reason = Timeout
30532024-08-16T07:18:50.863ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30542024-08-16T07:18:50.863ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 5 reason = Timeout
30552024-08-16T07:18:50.863ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 3 reason = Timeout
30562024-08-16T07:18:50.863ZINFOnexus (BackgroundTasks): lookup region port task started background_task = lookup_region_port file = nexus/src/app/background/tasks/lookup_region_port.rs:56
30572024-08-16T07:18:50.863ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
30582024-08-16T07:18:50.863ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 13 reason = Timeout
30592024-08-16T07:18:50.863ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
30602024-08-16T07:18:50.863ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30612024-08-16T07:18:50.863ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 5 reason = Timeout
30622024-08-16T07:18:50.863ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30632024-08-16T07:18:50.863ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 3 reason = Timeout
30642024-08-16T07:18:50.863ZINFOnexus (BackgroundTasks): Abandoned VMM reaper running background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:76
30652024-08-16T07:18:50.863ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
30662024-08-16T07:18:50.863ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 5 reason = Timeout
30672024-08-16T07:18:50.863ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 5 reason = Timeout
30682024-08-16T07:18:50.863ZWARNnexus (BackgroundTasks): region replacement task started background_task = region_replacement file = nexus/src/app/background/tasks/region_replacement.rs:64
30692024-08-16T07:18:50.863ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
30702024-08-16T07:18:50.863ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
30712024-08-16T07:18:50.863ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 5 reason = Timeout
30722024-08-16T07:18:50.863ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
30732024-08-16T07:18:50.863ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
30742024-08-16T07:18:50.863ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 5 reason = Timeout
30752024-08-16T07:18:50.863ZINFOnexus (BackgroundTasks): region snapshot replacement garbage collect task started background_task = region_snapshot_replacement_garbage_collection file = nexus/src/app/background/tasks/region_snapshot_replacement_garbage_collect.rs:133
30762024-08-16T07:18:50.863ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
30772024-08-16T07:18:50.863ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 5 reason = Timeout
30782024-08-16T07:18:50.863ZINFOnexus (BackgroundTasks): region snapshot replacement start task started background_task = region_snapshot_replacement_start file = nexus/src/app/background/tasks/region_snapshot_replacement_start.rs:236
30792024-08-16T07:18:50.863ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
30802024-08-16T07:18:50.863ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
30812024-08-16T07:18:50.863ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
30822024-08-16T07:18:50.863ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
30832024-08-16T07:18:50.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30842024-08-16T07:18:50.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30852024-08-16T07:18:50.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30862024-08-16T07:18:50.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
30872024-08-16T07:18:50.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
30882024-08-16T07:18:50.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30892024-08-16T07:18:50.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30902024-08-16T07:18:50.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
30912024-08-16T07:18:50.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
30922024-08-16T07:18:50.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
30932024-08-16T07:18:50.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
30942024-08-16T07:18:50.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
30952024-08-16T07:18:50.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
30962024-08-16T07:18:50.863ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
30972024-08-16T07:18:50.863ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
30982024-08-16T07:18:50.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
30992024-08-16T07:18:50.864ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31002024-08-16T07:18:50.864ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31012024-08-16T07:18:50.865ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31022024-08-16T07:18:50.865ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31032024-08-16T07:18:50.865ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
31042024-08-16T07:18:50.865ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
31052024-08-16T07:18:50.865ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31062024-08-16T07:18:50.865ZINFOnexus (BackgroundTasks): lookup region port task done background_task = lookup_region_port file = nexus/src/app/background/tasks/lookup_region_port.rs:150
31072024-08-16T07:18:50.865ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 2.262762ms iteration = 3 status = {"errors":[],"found_port_ok":[]}
31082024-08-16T07:18:50.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31092024-08-16T07:18:50.866ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31102024-08-16T07:18:50.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31112024-08-16T07:18:50.867ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31122024-08-16T07:18:50.867ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
31132024-08-16T07:18:50.868ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
31142024-08-16T07:18:50.868ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31152024-08-16T07:18:50.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31162024-08-16T07:18:50.868ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
31172024-08-16T07:18:50.868ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31182024-08-16T07:18:50.868ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
31192024-08-16T07:18:50.868ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
31202024-08-16T07:18:50.868ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
31212024-08-16T07:18:50.868ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
31222024-08-16T07:18:50.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31232024-08-16T07:18:50.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
31242024-08-16T07:18:50.869ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31252024-08-16T07:18:50.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31262024-08-16T07:18:50.869ZWARNnexus (BackgroundTasks): physical disk adoption task started background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:100
31272024-08-16T07:18:50.869ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
31282024-08-16T07:18:50.869ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31292024-08-16T07:18:50.869ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
31302024-08-16T07:18:50.869ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
31312024-08-16T07:18:50.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
31322024-08-16T07:18:50.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
31332024-08-16T07:18:50.870ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
31342024-08-16T07:18:50.870ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 7.443682ms iteration = 13 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
31352024-08-16T07:18:50.870ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
31362024-08-16T07:18:50.870ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31372024-08-16T07:18:50.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31382024-08-16T07:18:50.870ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31392024-08-16T07:18:50.870ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1194, tv_nsec: 246569502 } })
31402024-08-16T07:18:50.871ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31412024-08-16T07:18:50.872ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
31422024-08-16T07:18:50.872ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
31432024-08-16T07:18:50.872ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
31442024-08-16T07:18:50.872ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31452024-08-16T07:18:50.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
31462024-08-16T07:18:50.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31472024-08-16T07:18:50.872ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
31482024-08-16T07:18:50.872ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
31492024-08-16T07:18:50.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
31502024-08-16T07:18:50.873ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31512024-08-16T07:18:50.874ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
31522024-08-16T07:18:50.874ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
31532024-08-16T07:18:50.874ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 11.28916ms iteration = 3 status = {"error":null,"error_count":0,"found":0,"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0}
31542024-08-16T07:18:50.874ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
31552024-08-16T07:18:50.874ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
31562024-08-16T07:18:50.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
31572024-08-16T07:18:50.875ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
31582024-08-16T07:18:50.876ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
31592024-08-16T07:18:50.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
31602024-08-16T07:18:50.876ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
31612024-08-16T07:18:50.876ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = ddebb22e-3faa-4936-9b3e-0f4d28827c0e dns_zone_name = oxide.test found_so_far = 0 version = 2
31622024-08-16T07:18:50.876ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
31632024-08-16T07:18:50.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
31642024-08-16T07:18:50.877ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31652024-08-16T07:18:50.878ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
31662024-08-16T07:18:50.878ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.043166ms iteration = 13 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
31672024-08-16T07:18:50.879ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31682024-08-16T07:18:50.879ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
31692024-08-16T07:18:50.879ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
31702024-08-16T07:18:50.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
31712024-08-16T07:18:50.880ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
31722024-08-16T07:18:50.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
31732024-08-16T07:18:50.881ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
31742024-08-16T07:18:50.882ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
31752024-08-16T07:18:50.882ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
31762024-08-16T07:18:50.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
31772024-08-16T07:18:50.883ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
31782024-08-16T07:18:50.883ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
31792024-08-16T07:18:50.883ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
31802024-08-16T07:18:50.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
31812024-08-16T07:18:50.883ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
31822024-08-16T07:18:50.883ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 20.3326ms iteration = 5 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
31832024-08-16T07:18:50.885ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = ddebb22e-3faa-4936-9b3e-0f4d28827c0e dns_zone_name = oxide.test found_so_far = 1 version = 2
31842024-08-16T07:18:50.885ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
31852024-08-16T07:18:50.885ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-08-16 07:16:55.724690 UTC dns_group = external generation = 2
31862024-08-16T07:18:50.885ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 27.986606ms iteration = 3 status = {"generation":2}
31872024-08-16T07:18:50.886ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
31882024-08-16T07:18:50.886ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 23.269227ms iteration = 5 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
31892024-08-16T07:18:50.904ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
31902024-08-16T07:18:50.904ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
31912024-08-16T07:18:50.904ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
31922024-08-16T07:18:50.904ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
31932024-08-16T07:18:50.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
31942024-08-16T07:18:50.905ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31952024-08-16T07:18:50.908ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
31962024-08-16T07:18:50.908ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
31972024-08-16T07:18:50.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
31982024-08-16T07:18:50.908ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
31992024-08-16T07:18:50.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32002024-08-16T07:18:50.909ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
32012024-08-16T07:18:50.909ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 2c55b660-f328-498e-b44c-73da75015ed4 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
32022024-08-16T07:18:50.909ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
32032024-08-16T07:18:50.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
32042024-08-16T07:18:50.909ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
32052024-08-16T07:18:50.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
32062024-08-16T07:18:50.910ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32072024-08-16T07:18:50.911ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32082024-08-16T07:18:50.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32092024-08-16T07:18:50.911ZWARNnexus (BackgroundTasks): region replacement task done background_task = region_replacement file = nexus/src/app/background/tasks/region_replacement.rs:185
32102024-08-16T07:18:50.911ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 48.377738ms iteration = 5 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
32112024-08-16T07:18:50.912ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32122024-08-16T07:18:50.912ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
32132024-08-16T07:18:50.912ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
32142024-08-16T07:18:50.912ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 54.667072ms iteration = 3 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
32152024-08-16T07:18:50.913ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
32162024-08-16T07:18:50.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
32172024-08-16T07:18:50.913ZINFOnexus (BackgroundTasks): region snapshot replacement garbage collect task done background_task = region_snapshot_replacement_garbage_collection file = nexus/src/app/background/tasks/region_snapshot_replacement_garbage_collect.rs:147
32182024-08-16T07:18:50.913ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 50.277731ms iteration = 5 status = {"errors":[],"garbage_collect_requested":[]}
32192024-08-16T07:18:50.914ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
32202024-08-16T07:18:50.914ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
32212024-08-16T07:18:50.914ZINFOnexus (BackgroundTasks): region snapshot replacement start task done background_task = region_snapshot_replacement_start file = nexus/src/app/background/tasks/region_snapshot_replacement_start.rs:252
32222024-08-16T07:18:50.914ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 50.955047ms iteration = 5 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
32232024-08-16T07:18:50.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
32242024-08-16T07:18:50.914ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae, lookup_type: ById(03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae) } result = Ok(())
32252024-08-16T07:18:50.914ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32262024-08-16T07:18:50.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32272024-08-16T07:18:50.915ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
32282024-08-16T07:18:50.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
32292024-08-16T07:18:50.915ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 52.874161ms iteration = 5 status = 0
32302024-08-16T07:18:50.916ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 2c55b660-f328-498e-b44c-73da75015ed4 dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
32312024-08-16T07:18:50.916ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
32322024-08-16T07:18:50.916ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-08-16 07:16:55.302318 UTC dns_group = internal generation = 1
32332024-08-16T07:18:50.916ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 58.932411ms iteration = 3 status = {"generation":1}
32342024-08-16T07:18:50.917ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
32352024-08-16T07:18:50.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
32362024-08-16T07:18:50.918ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32372024-08-16T07:18:50.920ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
32382024-08-16T07:18:50.920ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
32392024-08-16T07:18:50.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
32402024-08-16T07:18:50.950ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
32412024-08-16T07:18:50.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
32422024-08-16T07:18:50.951ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32432024-08-16T07:18:50.953ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
32442024-08-16T07:18:50.953ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
32452024-08-16T07:18:50.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
32462024-08-16T07:18:50.954ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32472024-08-16T07:18:50.955ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
32482024-08-16T07:18:50.955ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
32492024-08-16T07:18:50.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
32502024-08-16T07:18:50.968ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-08-16T07:16:49.943339Z, time_modified: 2024-08-16T07:16:49.943339Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, db_silo: Silo { identity: SiloIdentity { id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-16T07:16:55.682566Z, time_modified: 2024-08-16T07:16:55.682566Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "c9e400628d2b58a74b998fbfa44a053952e83a6e8d3c49e6518981bf7d4a006f" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, db_silo: Silo { identity: SiloIdentity { id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-16T07:16:55.682566Z, time_modified: 2024-08-16T07:16:55.682566Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "c9e400628d2b58a74b998fbfa44a053952e83a6e8d3c49e6518981bf7d4a006f" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
32512024-08-16T07:18:50.968ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 111.71154ms iteration = 3 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071","tls_certs":["c9e400628d2b58a74b998fbfa44a053952e83a6e8d3c49e6518981bf7d4a006f"]}},"default_endpoint":{"silo_id":"439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071","tls_certs":["c9e400628d2b58a74b998fbfa44a053952e83a6e8d3c49e6518981bf7d4a006f"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
32522024-08-16T07:18:51.029ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a zone_address = fd00:1122:3344:101::2
32532024-08-16T07:18:51.029ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
32542024-08-16T07:18:51.029ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "260e0bcf-b85a-4181-8a85-da98a80611a1", "content-length": "26", "date": "Fri, 16 Aug 2024 07:18:51 GMT"} })
32552024-08-16T07:18:51.029ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
32562024-08-16T07:18:51.031ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
32572024-08-16T07:18:51.031ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
32582024-08-16T07:18:51.062ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
32592024-08-16T07:18:51.062ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
32602024-08-16T07:18:51.062ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "94846532-15f4-4ae7-b053-17984966fec0", "content-length": "26", "date": "Fri, 16 Aug 2024 07:18:51 GMT"} })
32612024-08-16T07:18:51.062ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
32622024-08-16T07:18:51.064ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
32632024-08-16T07:18:51.072ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
32642024-08-16T07:18:51.072ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "29d76362-c225-4b6f-8616-a48ed413b9a2", "content-length": "372", "date": "Fri, 16 Aug 2024 07:18:51 GMT"} })
32652024-08-16T07:18:51.072ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32662024-08-16T07:18:51.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32672024-08-16T07:18:51.075ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32682024-08-16T07:18:51.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32692024-08-16T07:18:51.077ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32702024-08-16T07:18:51.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32712024-08-16T07:18:51.080ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
32722024-08-16T07:18:51.081ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "221a37d7-3db7-46cc-9a1e-d94c1d219465", "date": "Fri, 16 Aug 2024 07:18:51 GMT"} })
32732024-08-16T07:18:51.082ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 219.464649ms iteration = 5 status = {}
32742024-08-16T07:18:51.103ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 4dc04ab8-6b69-4e24-a6cc-2266cd82b670 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
32752024-08-16T07:18:51.103ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 4dc04ab8-6b69-4e24-a6cc-2266cd82b670 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
32762024-08-16T07:18:51.105ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2413 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 4dc04ab8-6b69-4e24-a6cc-2266cd82b670 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
32772024-08-16T07:18:51.122ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
32782024-08-16T07:18:51.122ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "4a76a26b-acea-4f38-8551-31118d670c71", "content-length": "691", "date": "Fri, 16 Aug 2024 07:18:51 GMT"} })
32792024-08-16T07:18:51.122ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
32802024-08-16T07:18:51.122ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
32812024-08-16T07:18:51.122ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
32822024-08-16T07:18:51.124ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 261.576341ms iteration = 5 status = {}
32832024-08-16T07:18:51.199ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
32842024-08-16T07:18:51.207ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 350.564346ms iteration = 5 status = {}
32852024-08-16T07:18:51.208ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
32862024-08-16T07:18:51.208ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
32872024-08-16T07:18:51.208ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "7bdcdb06-d5ee-4e84-be92-b64832499855", "content-length": "26", "date": "Fri, 16 Aug 2024 07:18:51 GMT"} })
32882024-08-16T07:18:51.208ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
32892024-08-16T07:18:51.210ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
32902024-08-16T07:18:51.230ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
32912024-08-16T07:18:51.322ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
32922024-08-16T07:18:51.323ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "3db535b9-b253-4513-b87d-e525c6989756", "date": "Fri, 16 Aug 2024 07:18:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
32932024-08-16T07:18:51.323ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
32942024-08-16T07:18:51.324ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "5a8f991e-32a1-4cab-abb5-3e7ca6973c61", "date": "Fri, 16 Aug 2024 07:18:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
32952024-08-16T07:18:51.324ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
32962024-08-16T07:18:51.326ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "c0686bc0-1c6a-4c5f-a2ab-6d4e196b1b03", "date": "Fri, 16 Aug 2024 07:18:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
32972024-08-16T07:18:51.326ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
32982024-08-16T07:18:51.327ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
32992024-08-16T07:18:51.327ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 470.622239ms iteration = 5 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
33002024-08-16T07:18:51.330ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
33012024-08-16T07:18:51.330ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "44d3e91c-6a5e-4cc6-bf77-58531e65d6b5", "content-length": "1", "date": "Fri, 16 Aug 2024 07:18:50 GMT"} })
33022024-08-16T07:18:51.332ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
33032024-08-16T07:18:51.332ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
33042024-08-16T07:18:51.334ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 477.312594ms iteration = 5 status = null
33052024-08-16T07:18:51.335ZWARNnexus (BackgroundTasks): physical disk adoption task done background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:174
33062024-08-16T07:18:51.335ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 477.555209ms iteration = 7 status = {"physical_disks_added":0}
33072024-08-16T07:18:51.377ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
33082024-08-16T07:18:51.378ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "3c56598f-046c-4ca9-91a4-27e0b1df4cb9", "date": "Fri, 16 Aug 2024 07:18:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
33092024-08-16T07:18:51.378ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
33102024-08-16T07:18:51.380ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "a4dbdd05-cb89-4b23-a5b9-c19090fb6c68", "date": "Fri, 16 Aug 2024 07:18:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
33112024-08-16T07:18:51.380ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
33122024-08-16T07:18:51.381ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
33132024-08-16T07:18:51.381ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 518.693619ms iteration = 5 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
33142024-08-16T07:18:51.454ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33152024-08-16T07:18:51.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33162024-08-16T07:18:51.456ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:146 port = SwitchPort { id: f13c0939-2c9d-4a0d-b006-5f3de89cc4fc, rack_id: e1b0d583-7b20-4a4b-97f9-9f83300aeb7a, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(4de7fcf8-2b1f-4b0e-ba6f-584e8a34addb) } rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0
33172024-08-16T07:18:51.456ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33182024-08-16T07:18:51.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33192024-08-16T07:18:51.465ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
33202024-08-16T07:18:51.466ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "4a21fdad-0d8c-4aa5-8b8a-bb66e62150d6", "content-length": "121", "date": "Fri, 16 Aug 2024 07:18:50 GMT"} })
33212024-08-16T07:18:51.466ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1663 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
33222024-08-16T07:18:51.466ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1690 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 4de7fcf8-2b1f-4b0e-ba6f-584e8a34addb
33232024-08-16T07:18:51.466ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None)}}
33242024-08-16T07:18:51.466ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None)}}
33252024-08-16T07:18:51.466ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {}
33262024-08-16T07:18:51.466ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {}
33272024-08-16T07:18:51.466ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
33282024-08-16T07:18:51.466ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33292024-08-16T07:18:51.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33302024-08-16T07:18:51.468ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
33312024-08-16T07:18:51.468ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "843f760e-e78d-4912-a5d3-e35b723600e7", "content-length": "2", "date": "Fri, 16 Aug 2024 07:18:50 GMT"} })
33322024-08-16T07:18:51.468ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
33332024-08-16T07:18:51.468ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e614a2c8-43ce-4fd2-a72d-456767089d20", "content-length": "52", "date": "Fri, 16 Aug 2024 07:18:50 GMT"} })
33342024-08-16T07:18:51.468ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0
33352024-08-16T07:18:51.468ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
33362024-08-16T07:18:51.505ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 644 local_addr = [fd00:1122:3344:101::c]:53719 method = GET remote_addr = [fd00:1122:3344:101::d]:60737 req_id = f99a2a28-a52e-4fd6-8ae8-bdeb5ee9f2c3 response_code = 200 uri = /0d900881-9285-4dbf-910f-5e4676c8f133
33372024-08-16T07:18:51.520ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "263e4da5-84d2-41f1-bf37-050a9c774ccc", "date": "Fri, 16 Aug 2024 07:18:51 GMT"} })
33382024-08-16T07:18:51.520ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch = Switch0
33392024-08-16T07:18:51.520ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
33402024-08-16T07:18:51.520ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "2ccafc07-5562-447d-826e-9f9ce565417c", "content-length": "494", "date": "Fri, 16 Aug 2024 07:18:51 GMT"} })
33412024-08-16T07:18:51.520ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33422024-08-16T07:18:51.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33432024-08-16T07:18:51.523ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33442024-08-16T07:18:51.523ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33452024-08-16T07:18:51.525ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33462024-08-16T07:18:51.525ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33472024-08-16T07:18:51.527ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33482024-08-16T07:18:51.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33492024-08-16T07:18:51.536ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 673.872403ms iteration = 5 status = {}
33502024-08-16T07:18:51.764ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64556 req_id = 2ab92a0c-9551-4460-8880-88913c270338 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
33512024-08-16T07:18:51.764ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64556 req_id = 2ab92a0c-9551-4460-8880-88913c270338 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
33522024-08-16T07:18:51.766ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2420 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64556 req_id = 2ab92a0c-9551-4460-8880-88913c270338 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
33532024-08-16T07:18:52.125ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 2b48a822-3f6f-4fd0-81cd-71162f66ad95 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
33542024-08-16T07:18:52.126ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 2b48a822-3f6f-4fd0-81cd-71162f66ad95 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
33552024-08-16T07:18:52.127ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1891 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 2b48a822-3f6f-4fd0-81cd-71162f66ad95 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
33562024-08-16T07:18:53.144ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 6ba774d1-6b0e-4438-980b-dc9254a71ebb roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
33572024-08-16T07:18:53.144ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 6ba774d1-6b0e-4438-980b-dc9254a71ebb resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
33582024-08-16T07:18:53.146ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2236 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 6ba774d1-6b0e-4438-980b-dc9254a71ebb response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
33592024-08-16T07:18:54.165ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = cf1784f6-965f-4941-8b93-08031647f1b7 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
33602024-08-16T07:18:54.165ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = cf1784f6-965f-4941-8b93-08031647f1b7 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
33612024-08-16T07:18:54.167ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2014 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = cf1784f6-965f-4941-8b93-08031647f1b7 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
33622024-08-16T07:18:55.187ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 863d14e5-4091-44d3-8959-6f7d369fe205 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
33632024-08-16T07:18:55.188ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 863d14e5-4091-44d3-8959-6f7d369fe205 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
33642024-08-16T07:18:55.189ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1934 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 863d14e5-4091-44d3-8959-6f7d369fe205 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
33652024-08-16T07:18:56.210ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 2d63950b-8b5c-4b30-818b-8268ff9993a7 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
33662024-08-16T07:18:56.211ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 2d63950b-8b5c-4b30-818b-8268ff9993a7 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
33672024-08-16T07:18:56.212ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1863 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 2d63950b-8b5c-4b30-818b-8268ff9993a7 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
33682024-08-16T07:18:57.232ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 070f215d-f73d-4afb-8362-a76ac04fb1ed roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
33692024-08-16T07:18:57.233ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 070f215d-f73d-4afb-8362-a76ac04fb1ed resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
33702024-08-16T07:18:57.234ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1916 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 070f215d-f73d-4afb-8362-a76ac04fb1ed response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
33712024-08-16T07:18:58.255ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 1360d902-6cb4-4f48-b95a-627fece1bf3b roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
33722024-08-16T07:18:58.255ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 1360d902-6cb4-4f48-b95a-627fece1bf3b resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
33732024-08-16T07:18:58.257ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1985 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 1360d902-6cb4-4f48-b95a-627fece1bf3b response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
33742024-08-16T07:18:59.275ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 1c224bff-46c3-4d29-add5-4af44a9d4077 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
33752024-08-16T07:18:59.275ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 1c224bff-46c3-4d29-add5-4af44a9d4077 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
33762024-08-16T07:18:59.277ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2114 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 1c224bff-46c3-4d29-add5-4af44a9d4077 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
33772024-08-16T07:19:00.298ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = dc20390e-6171-4b35-857f-5e20a80c9e12 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
33782024-08-16T07:19:00.298ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = dc20390e-6171-4b35-857f-5e20a80c9e12 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
33792024-08-16T07:19:00.300ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2108 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = dc20390e-6171-4b35-857f-5e20a80c9e12 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
33802024-08-16T07:19:00.857ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 14 reason = Timeout
33812024-08-16T07:19:00.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33822024-08-16T07:19:00.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33832024-08-16T07:19:00.858ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33842024-08-16T07:19:00.861ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
33852024-08-16T07:19:00.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33862024-08-16T07:19:00.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33872024-08-16T07:19:00.862ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33882024-08-16T07:19:00.862ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 14 reason = Timeout
33892024-08-16T07:19:00.862ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
33902024-08-16T07:19:00.862ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
33912024-08-16T07:19:00.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33922024-08-16T07:19:00.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
33932024-08-16T07:19:00.863ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33942024-08-16T07:19:00.864ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
33952024-08-16T07:19:00.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
33962024-08-16T07:19:00.865ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
33972024-08-16T07:19:00.865ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.430989ms iteration = 14 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
33982024-08-16T07:19:00.866ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
33992024-08-16T07:19:00.866ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34002024-08-16T07:19:00.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34012024-08-16T07:19:00.875ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
34022024-08-16T07:19:00.875ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.325603ms iteration = 14 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
34032024-08-16T07:19:01.319ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = fd74063f-6e18-43e0-ac45-c6a20dd29e0d roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
34042024-08-16T07:19:01.320ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = fd74063f-6e18-43e0-ac45-c6a20dd29e0d resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
34052024-08-16T07:19:01.322ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2151 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = fd74063f-6e18-43e0-ac45-c6a20dd29e0d response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
34062024-08-16T07:19:01.506ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 617 local_addr = [fd00:1122:3344:101::c]:53719 method = GET remote_addr = [fd00:1122:3344:101::d]:60737 req_id = 1630e454-f4ae-470c-be5d-414d78769797 response_code = 200 uri = /0d900881-9285-4dbf-910f-5e4676c8f133
34072024-08-16T07:19:02.342ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = ecb3104f-2e59-436d-840c-07da4cb684a1 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
34082024-08-16T07:19:02.342ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = ecb3104f-2e59-436d-840c-07da4cb684a1 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
34092024-08-16T07:19:02.344ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1959 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = ecb3104f-2e59-436d-840c-07da4cb684a1 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
34102024-08-16T07:19:03.362ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 005c7023-4420-4a00-8d75-bd70ef8854d1 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
34112024-08-16T07:19:03.362ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 005c7023-4420-4a00-8d75-bd70ef8854d1 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
34122024-08-16T07:19:03.364ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1848 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 005c7023-4420-4a00-8d75-bd70ef8854d1 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
34132024-08-16T07:19:04.383ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 20ec5865-c2dd-43ff-999a-9f1fa7fbcff2 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
34142024-08-16T07:19:04.384ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 20ec5865-c2dd-43ff-999a-9f1fa7fbcff2 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
34152024-08-16T07:19:04.385ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1839 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 20ec5865-c2dd-43ff-999a-9f1fa7fbcff2 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
34162024-08-16T07:19:05.406ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 072cb028-4501-4394-8c8f-34477f1ccbeb roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
34172024-08-16T07:19:05.406ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 072cb028-4501-4394-8c8f-34477f1ccbeb resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
34182024-08-16T07:19:05.407ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1751 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 072cb028-4501-4394-8c8f-34477f1ccbeb response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
34192024-08-16T07:19:06.426ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 193e71e8-6407-4a9e-8054-b53db9f7fb82 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
34202024-08-16T07:19:06.427ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 193e71e8-6407-4a9e-8054-b53db9f7fb82 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
34212024-08-16T07:19:06.428ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2204 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 193e71e8-6407-4a9e-8054-b53db9f7fb82 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
34222024-08-16T07:19:07.448ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 92c44d39-e898-4b12-9cc9-2117d60976ec roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
34232024-08-16T07:19:07.448ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 92c44d39-e898-4b12-9cc9-2117d60976ec resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
34242024-08-16T07:19:07.450ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2007 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 92c44d39-e898-4b12-9cc9-2117d60976ec response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
34252024-08-16T07:19:08.470ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = d7d63ed6-2d6f-4ad5-9983-2051fd32e3ce roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
34262024-08-16T07:19:08.470ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = d7d63ed6-2d6f-4ad5-9983-2051fd32e3ce resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
34272024-08-16T07:19:08.472ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2325 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = d7d63ed6-2d6f-4ad5-9983-2051fd32e3ce response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
34282024-08-16T07:19:09.492ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = b92957aa-4c22-42a1-a6a9-e05f91010dd3 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
34292024-08-16T07:19:09.492ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = b92957aa-4c22-42a1-a6a9-e05f91010dd3 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
34302024-08-16T07:19:09.494ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2025 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = b92957aa-4c22-42a1-a6a9-e05f91010dd3 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
34312024-08-16T07:19:10.512ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 40cf28d5-c379-4bf3-b387-09377a390f60 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
34322024-08-16T07:19:10.513ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 40cf28d5-c379-4bf3-b387-09377a390f60 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
34332024-08-16T07:19:10.514ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1810 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 40cf28d5-c379-4bf3-b387-09377a390f60 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
34342024-08-16T07:19:10.856ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 15 reason = Timeout
34352024-08-16T07:19:10.856ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34362024-08-16T07:19:10.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34372024-08-16T07:19:10.858ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34382024-08-16T07:19:10.860ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
34392024-08-16T07:19:10.860ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34402024-08-16T07:19:10.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34412024-08-16T07:19:10.862ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34422024-08-16T07:19:10.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34432024-08-16T07:19:10.862ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 15 reason = Timeout
34442024-08-16T07:19:10.862ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
34452024-08-16T07:19:10.862ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34462024-08-16T07:19:10.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34472024-08-16T07:19:10.863ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34482024-08-16T07:19:10.863ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34492024-08-16T07:19:10.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34502024-08-16T07:19:10.865ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
34512024-08-16T07:19:10.865ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 2.690953ms iteration = 15 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
34522024-08-16T07:19:10.865ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
34532024-08-16T07:19:10.865ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34542024-08-16T07:19:10.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34552024-08-16T07:19:10.872ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
34562024-08-16T07:19:10.872ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 16.252416ms iteration = 15 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
34572024-08-16T07:19:11.505ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 566 local_addr = [fd00:1122:3344:101::c]:53719 method = GET remote_addr = [fd00:1122:3344:101::d]:60737 req_id = 5ff0f1c6-5440-4308-b92e-aef6d1818d41 response_code = 200 uri = /0d900881-9285-4dbf-910f-5e4676c8f133
34582024-08-16T07:19:11.533ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 86929dc2-612e-4603-806a-b8c32df62e62 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
34592024-08-16T07:19:11.534ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 86929dc2-612e-4603-806a-b8c32df62e62 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
34602024-08-16T07:19:11.535ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1955 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 86929dc2-612e-4603-806a-b8c32df62e62 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
34612024-08-16T07:19:12.555ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 0d94cbc7-c868-46d3-858a-dfa4cf92fbc7 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
34622024-08-16T07:19:12.555ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 0d94cbc7-c868-46d3-858a-dfa4cf92fbc7 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
34632024-08-16T07:19:12.556ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1612 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 0d94cbc7-c868-46d3-858a-dfa4cf92fbc7 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
34642024-08-16T07:19:13.576ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 006c83d7-7d68-4e6f-9c39-0611adb5419f roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
34652024-08-16T07:19:13.576ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 006c83d7-7d68-4e6f-9c39-0611adb5419f resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
34662024-08-16T07:19:13.577ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1726 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 006c83d7-7d68-4e6f-9c39-0611adb5419f response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
34672024-08-16T07:19:14.598ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 63a786a3-bbd4-4653-8b48-3956ea5228e4 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
34682024-08-16T07:19:14.599ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 63a786a3-bbd4-4653-8b48-3956ea5228e4 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
34692024-08-16T07:19:14.601ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 3118 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 63a786a3-bbd4-4653-8b48-3956ea5228e4 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
34702024-08-16T07:19:15.620ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 86dd14f1-4b34-4448-bd21-c706ac2ef93a roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
34712024-08-16T07:19:15.621ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 86dd14f1-4b34-4448-bd21-c706ac2ef93a resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
34722024-08-16T07:19:15.623ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2576 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 86dd14f1-4b34-4448-bd21-c706ac2ef93a response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
34732024-08-16T07:19:16.643ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 8421ec18-ed8b-4422-bfd1-b82121c43a9f roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
34742024-08-16T07:19:16.643ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 8421ec18-ed8b-4422-bfd1-b82121c43a9f resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
34752024-08-16T07:19:16.645ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2466 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 8421ec18-ed8b-4422-bfd1-b82121c43a9f response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
34762024-08-16T07:19:17.665ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = cb5a1e66-ff58-4dfb-be80-7cdecc9c8a46 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
34772024-08-16T07:19:17.665ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = cb5a1e66-ff58-4dfb-be80-7cdecc9c8a46 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
34782024-08-16T07:19:17.667ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2167 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = cb5a1e66-ff58-4dfb-be80-7cdecc9c8a46 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
34792024-08-16T07:19:18.688ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = ca30f950-3a44-4017-94ad-e461c9cc371c roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
34802024-08-16T07:19:18.688ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = ca30f950-3a44-4017-94ad-e461c9cc371c resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
34812024-08-16T07:19:18.690ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2638 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = ca30f950-3a44-4017-94ad-e461c9cc371c response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
34822024-08-16T07:19:19.709ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 18af6be0-78c0-4096-a139-286a6663bc7f roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
34832024-08-16T07:19:19.709ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 18af6be0-78c0-4096-a139-286a6663bc7f resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
34842024-08-16T07:19:19.711ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2267 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 18af6be0-78c0-4096-a139-286a6663bc7f response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
34852024-08-16T07:19:20.731ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 0c110aca-3bd7-46d8-b04e-2f9e5d06c411 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
34862024-08-16T07:19:20.731ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 0c110aca-3bd7-46d8-b04e-2f9e5d06c411 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
34872024-08-16T07:19:20.733ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2392 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 0c110aca-3bd7-46d8-b04e-2f9e5d06c411 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
34882024-08-16T07:19:20.856ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 6 reason = Timeout
34892024-08-16T07:19:20.856ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
34902024-08-16T07:19:20.856ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 6 reason = Timeout
34912024-08-16T07:19:20.856ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 6 reason = Timeout
34922024-08-16T07:19:20.856ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
34932024-08-16T07:19:20.856ZWARNnexus (BackgroundTasks): phantom disk task started background_task = phantom_disks file = nexus/src/app/background/tasks/phantom_disks.rs:46
34942024-08-16T07:19:20.856ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 16 reason = Timeout
34952024-08-16T07:19:20.856ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34962024-08-16T07:19:20.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
34972024-08-16T07:19:20.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34982024-08-16T07:19:20.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
34992024-08-16T07:19:20.857ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 8 reason = Timeout
35002024-08-16T07:19:20.857ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
35012024-08-16T07:19:20.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
35022024-08-16T07:19:20.858ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35032024-08-16T07:19:20.858ZWARNnexus (BackgroundTasks): phantom disk task done background_task = phantom_disks file = nexus/src/app/background/tasks/phantom_disks.rs:93
35042024-08-16T07:19:20.858ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.199811ms iteration = 6 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
35052024-08-16T07:19:20.859ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35062024-08-16T07:19:20.859ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1224, tv_nsec: 235057148 } })
35072024-08-16T07:19:20.859ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
35082024-08-16T07:19:20.859ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1224, tv_nsec: 235759354 } })
35092024-08-16T07:19:20.860ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
35102024-08-16T07:19:20.861ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
35112024-08-16T07:19:20.861ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
35122024-08-16T07:19:20.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35132024-08-16T07:19:20.861ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
35142024-08-16T07:19:20.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
35152024-08-16T07:19:20.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35162024-08-16T07:19:20.862ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35172024-08-16T07:19:20.863ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 16 reason = Timeout
35182024-08-16T07:19:20.863ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
35192024-08-16T07:19:20.863ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
35202024-08-16T07:19:20.863ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 6 reason = Timeout
35212024-08-16T07:19:20.863ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 6 reason = Timeout
35222024-08-16T07:19:20.863ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35232024-08-16T07:19:20.863ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35242024-08-16T07:19:20.863ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 6 reason = Timeout
35252024-08-16T07:19:20.863ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35262024-08-16T07:19:20.863ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 6 reason = Timeout
35272024-08-16T07:19:20.863ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35282024-08-16T07:19:20.863ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 6 reason = Timeout
35292024-08-16T07:19:20.863ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
35302024-08-16T07:19:20.863ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
35312024-08-16T07:19:20.863ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 6 reason = Timeout
35322024-08-16T07:19:20.863ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
35332024-08-16T07:19:20.863ZWARNnexus (BackgroundTasks): physical disk adoption task started background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:100
35342024-08-16T07:19:20.863ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
35352024-08-16T07:19:20.863ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 6 reason = Timeout
35362024-08-16T07:19:20.863ZWARNnexus (BackgroundTasks): region replacement task started background_task = region_replacement file = nexus/src/app/background/tasks/region_replacement.rs:64
35372024-08-16T07:19:20.863ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 6 reason = Timeout
35382024-08-16T07:19:20.863ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
35392024-08-16T07:19:20.863ZINFOnexus (BackgroundTasks): region snapshot replacement garbage collect task started background_task = region_snapshot_replacement_garbage_collection file = nexus/src/app/background/tasks/region_snapshot_replacement_garbage_collect.rs:133
35402024-08-16T07:19:20.863ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
35412024-08-16T07:19:20.863ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 6 reason = Timeout
35422024-08-16T07:19:20.863ZINFOnexus (BackgroundTasks): region snapshot replacement start task started background_task = region_snapshot_replacement_start file = nexus/src/app/background/tasks/region_snapshot_replacement_start.rs:236
35432024-08-16T07:19:20.863ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
35442024-08-16T07:19:20.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35452024-08-16T07:19:20.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
35462024-08-16T07:19:20.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35472024-08-16T07:19:20.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35482024-08-16T07:19:20.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35492024-08-16T07:19:20.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
35502024-08-16T07:19:20.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
35512024-08-16T07:19:20.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35522024-08-16T07:19:20.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
35532024-08-16T07:19:20.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
35542024-08-16T07:19:20.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
35552024-08-16T07:19:20.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
35562024-08-16T07:19:20.864ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35572024-08-16T07:19:20.864ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35582024-08-16T07:19:20.864ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35592024-08-16T07:19:20.865ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35602024-08-16T07:19:20.865ZINFOnexus (BackgroundTasks): region snapshot replacement garbage collect task done background_task = region_snapshot_replacement_garbage_collection file = nexus/src/app/background/tasks/region_snapshot_replacement_garbage_collect.rs:147
35612024-08-16T07:19:20.865ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 2.109589ms iteration = 6 status = {"errors":[],"garbage_collect_requested":[]}
35622024-08-16T07:19:20.865ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35632024-08-16T07:19:20.865ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
35642024-08-16T07:19:20.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
35652024-08-16T07:19:20.866ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
35662024-08-16T07:19:20.866ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
35672024-08-16T07:19:20.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
35682024-08-16T07:19:20.867ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
35692024-08-16T07:19:20.867ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.310719ms iteration = 16 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
35702024-08-16T07:19:20.867ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
35712024-08-16T07:19:20.867ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35722024-08-16T07:19:20.868ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
35732024-08-16T07:19:20.868ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35742024-08-16T07:19:20.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35752024-08-16T07:19:20.868ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
35762024-08-16T07:19:20.868ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35772024-08-16T07:19:20.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35782024-08-16T07:19:20.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35792024-08-16T07:19:20.869ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35802024-08-16T07:19:20.869ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
35812024-08-16T07:19:20.869ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35822024-08-16T07:19:20.869ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1224, tv_nsec: 245636572 } })
35832024-08-16T07:19:20.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35842024-08-16T07:19:20.869ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35852024-08-16T07:19:20.870ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
35862024-08-16T07:19:20.871ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
35872024-08-16T07:19:20.871ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35882024-08-16T07:19:20.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35892024-08-16T07:19:20.871ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35902024-08-16T07:19:20.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35912024-08-16T07:19:20.872ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
35922024-08-16T07:19:20.872ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
35932024-08-16T07:19:20.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
35942024-08-16T07:19:20.873ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
35952024-08-16T07:19:20.873ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 10.82884ms iteration = 6 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
35962024-08-16T07:19:20.874ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
35972024-08-16T07:19:20.874ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.967885ms iteration = 16 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
35982024-08-16T07:19:20.887ZWARNnexus (BackgroundTasks): physical disk adoption task done background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:174
35992024-08-16T07:19:20.887ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 30.32265ms iteration = 8 status = {"physical_disks_added":0}
36002024-08-16T07:19:20.893ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36012024-08-16T07:19:20.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36022024-08-16T07:19:20.895ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36032024-08-16T07:19:20.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36042024-08-16T07:19:20.896ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36052024-08-16T07:19:20.900ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae, lookup_type: ById(03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae) } result = Ok(())
36062024-08-16T07:19:20.900ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36072024-08-16T07:19:20.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36082024-08-16T07:19:20.901ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 38.278564ms iteration = 6 status = 0
36092024-08-16T07:19:20.903ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
36102024-08-16T07:19:20.903ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
36112024-08-16T07:19:20.903ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
36122024-08-16T07:19:20.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
36132024-08-16T07:19:20.906ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
36142024-08-16T07:19:20.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
36152024-08-16T07:19:20.908ZINFOnexus (BackgroundTasks): region snapshot replacement start task done background_task = region_snapshot_replacement_start file = nexus/src/app/background/tasks/region_snapshot_replacement_start.rs:252
36162024-08-16T07:19:20.908ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 45.05317ms iteration = 6 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
36172024-08-16T07:19:20.910ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
36182024-08-16T07:19:20.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
36192024-08-16T07:19:20.910ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36202024-08-16T07:19:20.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36212024-08-16T07:19:20.912ZWARNnexus (BackgroundTasks): region replacement task done background_task = region_replacement file = nexus/src/app/background/tasks/region_replacement.rs:185
36222024-08-16T07:19:20.912ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 49.050243ms iteration = 6 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
36232024-08-16T07:19:20.919ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36242024-08-16T07:19:20.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36252024-08-16T07:19:20.920ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36262024-08-16T07:19:20.922ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
36272024-08-16T07:19:20.922ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36282024-08-16T07:19:20.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36292024-08-16T07:19:20.922ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36302024-08-16T07:19:20.924ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
36312024-08-16T07:19:20.924ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36322024-08-16T07:19:20.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36332024-08-16T07:19:20.930ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
36342024-08-16T07:19:20.930ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
36352024-08-16T07:19:20.930ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 67.782466ms iteration = 6 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
36362024-08-16T07:19:20.979ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
36372024-08-16T07:19:20.979ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
36382024-08-16T07:19:20.980ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6ef668fc-d440-4060-8c89-28f4cb6ff28b", "content-length": "26", "date": "Fri, 16 Aug 2024 07:19:20 GMT"} })
36392024-08-16T07:19:20.980ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
36402024-08-16T07:19:20.981ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
36412024-08-16T07:19:20.994ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
36422024-08-16T07:19:20.995ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "4c7798b2-c220-4437-af56-fa6c898178f5", "content-length": "372", "date": "Fri, 16 Aug 2024 07:19:20 GMT"} })
36432024-08-16T07:19:20.995ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36442024-08-16T07:19:20.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36452024-08-16T07:19:20.997ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36462024-08-16T07:19:20.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36472024-08-16T07:19:20.999ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a zone_address = fd00:1122:3344:101::2
36482024-08-16T07:19:20.999ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
36492024-08-16T07:19:20.999ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "db81cdbd-72bf-44d3-a675-277b4be9a8c1", "content-length": "26", "date": "Fri, 16 Aug 2024 07:19:20 GMT"} })
36502024-08-16T07:19:20.999ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
36512024-08-16T07:19:20.999ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36522024-08-16T07:19:21.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36532024-08-16T07:19:21.001ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
36542024-08-16T07:19:21.002ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
36552024-08-16T07:19:21.003ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "122904f0-822d-4e51-805e-c97de1e20c1f", "date": "Fri, 16 Aug 2024 07:19:20 GMT"} })
36562024-08-16T07:19:21.004ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 141.136639ms iteration = 6 status = {}
36572024-08-16T07:19:21.013ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
36582024-08-16T07:19:21.013ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
36592024-08-16T07:19:21.013ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ab05ac39-01f2-40a3-94c2-90a9c813f9d2", "content-length": "26", "date": "Fri, 16 Aug 2024 07:19:20 GMT"} })
36602024-08-16T07:19:21.013ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
36612024-08-16T07:19:21.015ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
36622024-08-16T07:19:21.089ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
36632024-08-16T07:19:21.090ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "914635b8-7b63-4ba5-b578-e9f6e29911ce", "content-length": "691", "date": "Fri, 16 Aug 2024 07:19:20 GMT"} })
36642024-08-16T07:19:21.090ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
36652024-08-16T07:19:21.090ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
36662024-08-16T07:19:21.090ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
36672024-08-16T07:19:21.092ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 229.305406ms iteration = 6 status = {}
36682024-08-16T07:19:21.268ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 412.005275ms iteration = 6 status = {}
36692024-08-16T07:19:21.282ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
36702024-08-16T07:19:21.283ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c5f511ba-6936-4287-bf4c-6db9542da0b8", "content-length": "1", "date": "Fri, 16 Aug 2024 07:19:20 GMT"} })
36712024-08-16T07:19:21.286ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
36722024-08-16T07:19:21.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
36732024-08-16T07:19:21.287ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 431.389903ms iteration = 6 status = null
36742024-08-16T07:19:21.349ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36752024-08-16T07:19:21.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36762024-08-16T07:19:21.351ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:146 port = SwitchPort { id: f13c0939-2c9d-4a0d-b006-5f3de89cc4fc, rack_id: e1b0d583-7b20-4a4b-97f9-9f83300aeb7a, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(4de7fcf8-2b1f-4b0e-ba6f-584e8a34addb) } rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0
36772024-08-16T07:19:21.351ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36782024-08-16T07:19:21.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36792024-08-16T07:19:21.359ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
36802024-08-16T07:19:21.359ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "26e6afd4-3c23-40e6-9b8f-70e6035c0069", "content-length": "121", "date": "Fri, 16 Aug 2024 07:19:20 GMT"} })
36812024-08-16T07:19:21.359ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1663 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
36822024-08-16T07:19:21.359ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1690 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 4de7fcf8-2b1f-4b0e-ba6f-584e8a34addb
36832024-08-16T07:19:21.360ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None)}}
36842024-08-16T07:19:21.360ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None)}}
36852024-08-16T07:19:21.360ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {}
36862024-08-16T07:19:21.360ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {}
36872024-08-16T07:19:21.360ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
36882024-08-16T07:19:21.360ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36892024-08-16T07:19:21.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36902024-08-16T07:19:21.447ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
36912024-08-16T07:19:21.447ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "05787d2e-a74a-4801-91f3-fe39afa63266", "content-length": "2", "date": "Fri, 16 Aug 2024 07:19:20 GMT"} })
36922024-08-16T07:19:21.447ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
36932024-08-16T07:19:21.447ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e4b1ac59-db27-4602-87ad-7a1f206a49e6", "content-length": "52", "date": "Fri, 16 Aug 2024 07:19:20 GMT"} })
36942024-08-16T07:19:21.447ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0
36952024-08-16T07:19:21.447ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
36962024-08-16T07:19:21.500ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "330cbff1-976d-4fee-b6da-0532853a948e", "date": "Fri, 16 Aug 2024 07:19:20 GMT"} })
36972024-08-16T07:19:21.500ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch = Switch0
36982024-08-16T07:19:21.500ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
36992024-08-16T07:19:21.501ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "8454254d-e8e4-4657-adfa-32ee4895b1ea", "content-length": "494", "date": "Fri, 16 Aug 2024 07:19:20 GMT"} })
37002024-08-16T07:19:21.501ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37012024-08-16T07:19:21.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37022024-08-16T07:19:21.504ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37032024-08-16T07:19:21.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37042024-08-16T07:19:21.506ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 558 local_addr = [fd00:1122:3344:101::c]:53719 method = GET remote_addr = [fd00:1122:3344:101::d]:60737 req_id = 06da0d2c-d5d3-42f6-99dd-391fd3509ada response_code = 200 uri = /0d900881-9285-4dbf-910f-5e4676c8f133
37052024-08-16T07:19:21.506ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37062024-08-16T07:19:21.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37072024-08-16T07:19:21.508ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37082024-08-16T07:19:21.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37092024-08-16T07:19:21.515ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 652.55464ms iteration = 6 status = {}
37102024-08-16T07:19:21.753ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 51af16f4-4720-41b9-8b62-091c613c3df0 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
37112024-08-16T07:19:21.753ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 51af16f4-4720-41b9-8b62-091c613c3df0 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
37122024-08-16T07:19:21.755ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2073 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 51af16f4-4720-41b9-8b62-091c613c3df0 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
37132024-08-16T07:19:21.798ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64556 req_id = 8dc42628-b164-43bd-a211-d2b67921e687 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
37142024-08-16T07:19:21.798ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64556 req_id = 8dc42628-b164-43bd-a211-d2b67921e687 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
37152024-08-16T07:19:21.800ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2706 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64556 req_id = 8dc42628-b164-43bd-a211-d2b67921e687 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
37162024-08-16T07:19:22.772ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = d18b2b92-7f52-44a0-bf1a-2d043f8bd3d0 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
37172024-08-16T07:19:22.772ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = d18b2b92-7f52-44a0-bf1a-2d043f8bd3d0 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
37182024-08-16T07:19:22.774ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1993 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = d18b2b92-7f52-44a0-bf1a-2d043f8bd3d0 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
37192024-08-16T07:19:23.793ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = a1873947-2a39-440c-9a4f-7c67a983778a roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
37202024-08-16T07:19:23.793ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = a1873947-2a39-440c-9a4f-7c67a983778a resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
37212024-08-16T07:19:23.794ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1658 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = a1873947-2a39-440c-9a4f-7c67a983778a response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
37222024-08-16T07:19:24.815ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 736b1eab-de31-4e6a-afa8-1be06a0cb9fa roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
37232024-08-16T07:19:24.815ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 736b1eab-de31-4e6a-afa8-1be06a0cb9fa resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
37242024-08-16T07:19:24.816ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1832 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 736b1eab-de31-4e6a-afa8-1be06a0cb9fa response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
37252024-08-16T07:19:25.834ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 7bb1cc2d-39fc-461d-95e6-638a9028e4bb roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
37262024-08-16T07:19:25.835ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 7bb1cc2d-39fc-461d-95e6-638a9028e4bb resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
37272024-08-16T07:19:25.836ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1745 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 7bb1cc2d-39fc-461d-95e6-638a9028e4bb response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
37282024-08-16T07:19:26.855ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 24aa624c-7c11-45a4-9e46-c412121378ce roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
37292024-08-16T07:19:26.856ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 24aa624c-7c11-45a4-9e46-c412121378ce resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
37302024-08-16T07:19:26.857ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1799 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 24aa624c-7c11-45a4-9e46-c412121378ce response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
37312024-08-16T07:19:27.878ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 66ef9dd7-9c33-452c-8fe1-1833e5fff291 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
37322024-08-16T07:19:27.879ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 66ef9dd7-9c33-452c-8fe1-1833e5fff291 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
37332024-08-16T07:19:27.880ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2634 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 66ef9dd7-9c33-452c-8fe1-1833e5fff291 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
37342024-08-16T07:19:28.900ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = c3bba9fe-b9d9-428a-acfa-9e4a0154ecc2 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
37352024-08-16T07:19:28.900ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = c3bba9fe-b9d9-428a-acfa-9e4a0154ecc2 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
37362024-08-16T07:19:28.902ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1792 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = c3bba9fe-b9d9-428a-acfa-9e4a0154ecc2 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
37372024-08-16T07:19:29.923ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = c9be6c20-3aa2-4d38-8d21-b53b1dd4cac4 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
37382024-08-16T07:19:29.923ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = c9be6c20-3aa2-4d38-8d21-b53b1dd4cac4 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
37392024-08-16T07:19:29.925ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2068 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = c9be6c20-3aa2-4d38-8d21-b53b1dd4cac4 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
37402024-08-16T07:19:30.856ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 17 reason = Timeout
37412024-08-16T07:19:30.856ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37422024-08-16T07:19:30.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37432024-08-16T07:19:30.858ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37442024-08-16T07:19:30.860ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
37452024-08-16T07:19:30.860ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37462024-08-16T07:19:30.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37472024-08-16T07:19:30.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37482024-08-16T07:19:30.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37492024-08-16T07:19:30.862ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37502024-08-16T07:19:30.862ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 17 reason = Timeout
37512024-08-16T07:19:30.862ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
37522024-08-16T07:19:30.862ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37532024-08-16T07:19:30.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37542024-08-16T07:19:30.864ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37552024-08-16T07:19:30.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37562024-08-16T07:19:30.865ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
37572024-08-16T07:19:30.865ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37582024-08-16T07:19:30.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37592024-08-16T07:19:30.866ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
37602024-08-16T07:19:30.866ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.774347ms iteration = 17 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
37612024-08-16T07:19:30.870ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
37622024-08-16T07:19:30.870ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 14.262499ms iteration = 17 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
37632024-08-16T07:19:30.946ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 3c76b780-3d08-4e85-a371-fb3acc8643b1 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
37642024-08-16T07:19:30.946ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 3c76b780-3d08-4e85-a371-fb3acc8643b1 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
37652024-08-16T07:19:30.948ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2211 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 3c76b780-3d08-4e85-a371-fb3acc8643b1 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
37662024-08-16T07:19:31.505ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 528 local_addr = [fd00:1122:3344:101::c]:53719 method = GET remote_addr = [fd00:1122:3344:101::d]:60737 req_id = 7dea0504-faa3-4e7f-bfb0-8a123716fd85 response_code = 200 uri = /0d900881-9285-4dbf-910f-5e4676c8f133
37672024-08-16T07:19:31.968ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 75495890-2676-42bd-8e25-0a87090d2885 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
37682024-08-16T07:19:31.968ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 75495890-2676-42bd-8e25-0a87090d2885 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
37692024-08-16T07:19:31.970ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2769 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 75495890-2676-42bd-8e25-0a87090d2885 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
37702024-08-16T07:19:32.990ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 444c9b74-a7b4-4cc9-9e10-4b45bea090f1 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
37712024-08-16T07:19:32.991ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 444c9b74-a7b4-4cc9-9e10-4b45bea090f1 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
37722024-08-16T07:19:32.992ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1814 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 444c9b74-a7b4-4cc9-9e10-4b45bea090f1 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
37732024-08-16T07:19:34.011ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 3cf628a9-0283-4270-bcb9-bc75edb99c1d roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
37742024-08-16T07:19:34.011ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 3cf628a9-0283-4270-bcb9-bc75edb99c1d resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
37752024-08-16T07:19:34.013ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2163 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 3cf628a9-0283-4270-bcb9-bc75edb99c1d response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
37762024-08-16T07:19:35.032ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = bee692a4-b834-4546-861d-a5db0b25468f roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
37772024-08-16T07:19:35.033ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = bee692a4-b834-4546-861d-a5db0b25468f resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
37782024-08-16T07:19:35.034ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2157 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = bee692a4-b834-4546-861d-a5db0b25468f response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
37792024-08-16T07:19:36.053ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 71646311-3ae1-4ef7-97d0-d8f14991c53d roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
37802024-08-16T07:19:36.054ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 71646311-3ae1-4ef7-97d0-d8f14991c53d resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
37812024-08-16T07:19:36.055ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1907 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 71646311-3ae1-4ef7-97d0-d8f14991c53d response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
37822024-08-16T07:19:37.075ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 278352ae-c9ea-4e39-881a-d9261e56901a roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
37832024-08-16T07:19:37.076ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 278352ae-c9ea-4e39-881a-d9261e56901a resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
37842024-08-16T07:19:37.077ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2174 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 278352ae-c9ea-4e39-881a-d9261e56901a response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
37852024-08-16T07:19:38.098ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = c023366e-405d-4fe7-9c78-33959bef4289 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
37862024-08-16T07:19:38.098ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = c023366e-405d-4fe7-9c78-33959bef4289 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
37872024-08-16T07:19:38.099ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1811 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = c023366e-405d-4fe7-9c78-33959bef4289 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
37882024-08-16T07:19:39.119ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = d27c5ef9-c222-4aa5-aa03-fef7946c8dc5 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
37892024-08-16T07:19:39.119ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = d27c5ef9-c222-4aa5-aa03-fef7946c8dc5 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
37902024-08-16T07:19:39.121ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1832 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = d27c5ef9-c222-4aa5-aa03-fef7946c8dc5 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
37912024-08-16T07:19:40.141ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 2131c83c-d3d8-45ad-a85b-ca9f030636da roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
37922024-08-16T07:19:40.141ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 2131c83c-d3d8-45ad-a85b-ca9f030636da resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
37932024-08-16T07:19:40.143ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2834 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 2131c83c-d3d8-45ad-a85b-ca9f030636da response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
37942024-08-16T07:19:40.856ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 18 reason = Timeout
37952024-08-16T07:19:40.856ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37962024-08-16T07:19:40.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37972024-08-16T07:19:40.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37982024-08-16T07:19:40.860ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
37992024-08-16T07:19:40.860ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38002024-08-16T07:19:40.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38012024-08-16T07:19:40.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38022024-08-16T07:19:40.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38032024-08-16T07:19:40.862ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38042024-08-16T07:19:40.862ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 18 reason = Timeout
38052024-08-16T07:19:40.862ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
38062024-08-16T07:19:40.862ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38072024-08-16T07:19:40.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38082024-08-16T07:19:40.863ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38092024-08-16T07:19:40.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38102024-08-16T07:19:40.864ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
38112024-08-16T07:19:40.864ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38122024-08-16T07:19:40.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38132024-08-16T07:19:40.865ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
38142024-08-16T07:19:40.865ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 2.940027ms iteration = 18 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
38152024-08-16T07:19:40.872ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
38162024-08-16T07:19:40.872ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 15.968378ms iteration = 18 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
38172024-08-16T07:19:41.164ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 6e33f596-83f3-49ad-aef7-7901090bc57e roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
38182024-08-16T07:19:41.164ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 6e33f596-83f3-49ad-aef7-7901090bc57e resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
38192024-08-16T07:19:41.166ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2619 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 6e33f596-83f3-49ad-aef7-7901090bc57e response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
38202024-08-16T07:19:41.505ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 543 local_addr = [fd00:1122:3344:101::c]:53719 method = GET remote_addr = [fd00:1122:3344:101::d]:60737 req_id = 98cbeac2-48c4-4f46-9d75-dc9891561271 response_code = 200 uri = /0d900881-9285-4dbf-910f-5e4676c8f133
38212024-08-16T07:19:42.185ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = af136e5c-f958-41b4-9196-410263d919d1 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
38222024-08-16T07:19:42.186ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = af136e5c-f958-41b4-9196-410263d919d1 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
38232024-08-16T07:19:42.188ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2228 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = af136e5c-f958-41b4-9196-410263d919d1 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
38242024-08-16T07:19:43.208ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 09ee25dc-3fdc-4259-85c3-0d773da3d046 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
38252024-08-16T07:19:43.209ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 09ee25dc-3fdc-4259-85c3-0d773da3d046 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
38262024-08-16T07:19:43.210ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1891 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 09ee25dc-3fdc-4259-85c3-0d773da3d046 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
38272024-08-16T07:19:44.232ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 6107d1b8-ee56-4a5e-8f73-3d92cf5e6b76 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
38282024-08-16T07:19:44.232ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 6107d1b8-ee56-4a5e-8f73-3d92cf5e6b76 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
38292024-08-16T07:19:44.234ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2357 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 6107d1b8-ee56-4a5e-8f73-3d92cf5e6b76 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
38302024-08-16T07:19:45.253ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 924062d8-2c48-4fb4-8bf0-53367e8f1087 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
38312024-08-16T07:19:45.253ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 924062d8-2c48-4fb4-8bf0-53367e8f1087 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
38322024-08-16T07:19:45.255ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2181 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 924062d8-2c48-4fb4-8bf0-53367e8f1087 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
38332024-08-16T07:19:46.274ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 68654686-74c8-4e3d-9352-c8b1f1e234bb roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
38342024-08-16T07:19:46.274ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 68654686-74c8-4e3d-9352-c8b1f1e234bb resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
38352024-08-16T07:19:46.276ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2300 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 68654686-74c8-4e3d-9352-c8b1f1e234bb response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
38362024-08-16T07:19:47.294ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = c3055b9d-3c6a-471d-a268-8713e59c93d6 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
38372024-08-16T07:19:47.295ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = c3055b9d-3c6a-471d-a268-8713e59c93d6 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
38382024-08-16T07:19:47.296ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1715 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = c3055b9d-3c6a-471d-a268-8713e59c93d6 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
38392024-08-16T07:19:48.315ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = f9023e0a-5c1d-4318-ae0d-f981fdeeaa85 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
38402024-08-16T07:19:48.315ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = f9023e0a-5c1d-4318-ae0d-f981fdeeaa85 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
38412024-08-16T07:19:48.317ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1743 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = f9023e0a-5c1d-4318-ae0d-f981fdeeaa85 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
38422024-08-16T07:19:49.336ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = e09733e1-d82d-485e-9f75-51624efff3fa roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
38432024-08-16T07:19:49.336ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = e09733e1-d82d-485e-9f75-51624efff3fa resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
38442024-08-16T07:19:49.337ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1719 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = e09733e1-d82d-485e-9f75-51624efff3fa response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
38452024-08-16T07:19:50.357ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 1025e7dd-52d2-4844-801f-fdd5920fad48 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
38462024-08-16T07:19:50.358ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 1025e7dd-52d2-4844-801f-fdd5920fad48 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
38472024-08-16T07:19:50.359ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1852 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 1025e7dd-52d2-4844-801f-fdd5920fad48 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
38482024-08-16T07:19:50.856ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 7 reason = Timeout
38492024-08-16T07:19:50.856ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 6 reason = Timeout
38502024-08-16T07:19:50.856ZWARNnexus (BackgroundTasks): phantom disk task started background_task = phantom_disks file = nexus/src/app/background/tasks/phantom_disks.rs:46
38512024-08-16T07:19:50.856ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 4 reason = Timeout
38522024-08-16T07:19:50.856ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 5 reason = Timeout
38532024-08-16T07:19:50.856ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:69 reason = blueprint disabled target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d
38542024-08-16T07:19:50.856ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 4 reason = Timeout
38552024-08-16T07:19:50.856ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
38562024-08-16T07:19:50.856ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 19.27\u{b5}s iteration = 5 status = {"error":"blueprint disabled","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d"}
38572024-08-16T07:19:50.856ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 4 reason = Timeout
38582024-08-16T07:19:50.856ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 7 reason = Timeout
38592024-08-16T07:19:50.856ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
38602024-08-16T07:19:50.856ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
38612024-08-16T07:19:50.856ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
38622024-08-16T07:19:50.856ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 4 reason = Timeout
38632024-08-16T07:19:50.856ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 4 reason = Timeout
38642024-08-16T07:19:50.856ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-08-16 07:09:50.856785318 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
38652024-08-16T07:19:50.856ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
38662024-08-16T07:19:50.856ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 7 reason = Timeout
38672024-08-16T07:19:50.856ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
38682024-08-16T07:19:50.856ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 19 reason = Timeout
38692024-08-16T07:19:50.856ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38702024-08-16T07:19:50.856ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 4 reason = Timeout
38712024-08-16T07:19:50.856ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
38722024-08-16T07:19:50.856ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
38732024-08-16T07:19:50.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
38742024-08-16T07:19:50.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
38752024-08-16T07:19:50.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
38762024-08-16T07:19:50.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
38772024-08-16T07:19:50.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38782024-08-16T07:19:50.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
38792024-08-16T07:19:50.857ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 3 reason = Timeout
38802024-08-16T07:19:50.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
38812024-08-16T07:19:50.857ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 4 reason = Timeout
38822024-08-16T07:19:50.857ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
38832024-08-16T07:19:50.857ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 9 reason = Timeout
38842024-08-16T07:19:50.857ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
38852024-08-16T07:19:50.857ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
38862024-08-16T07:19:50.857ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
38872024-08-16T07:19:50.857ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6d6264ea-5d56-4938-8c26-581ed0b9907b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a8440aa3-608b-4c08-b70c-6d92a9461396.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("aea2243f-052e-4953-bdfa-7c3368895dd2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("aea2243f-052e-4953-bdfa-7c3368895dd2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1254, tv_nsec: 233460123 } })
38882024-08-16T07:19:50.857ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("dec19c15-1a2d-47ac-9b9e-9f424d3a3464.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f9649eef-936b-4765-9810-da8662275db5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f9649eef-936b-4765-9810-da8662275db5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1254, tv_nsec: 233474073 } })
38892024-08-16T07:19:50.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
38902024-08-16T07:19:50.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
38912024-08-16T07:19:50.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
38922024-08-16T07:19:50.857ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
38932024-08-16T07:19:50.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
38942024-08-16T07:19:50.858ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
38952024-08-16T07:19:50.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
38962024-08-16T07:19:50.858ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
38972024-08-16T07:19:50.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
38982024-08-16T07:19:50.858ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
38992024-08-16T07:19:50.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
39002024-08-16T07:19:50.858ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39012024-08-16T07:19:50.858ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39022024-08-16T07:19:50.858ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
39032024-08-16T07:19:50.859ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39042024-08-16T07:19:50.859ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
39052024-08-16T07:19:50.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
39062024-08-16T07:19:50.859ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 2.423916ms iteration = 4 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
39072024-08-16T07:19:50.859ZWARNnexus (BackgroundTasks): phantom disk task done background_task = phantom_disks file = nexus/src/app/background/tasks/phantom_disks.rs:93
39082024-08-16T07:19:50.859ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.135372ms iteration = 7 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
39092024-08-16T07:19:50.859ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
39102024-08-16T07:19:50.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39112024-08-16T07:19:50.860ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
39122024-08-16T07:19:50.860ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 3.355038ms iteration = 4 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
39132024-08-16T07:19:50.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
39142024-08-16T07:19:50.860ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39152024-08-16T07:19:50.860ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1254, tv_nsec: 236498203 } })
39162024-08-16T07:19:50.861ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39172024-08-16T07:19:50.861ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
39182024-08-16T07:19:50.861ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
39192024-08-16T07:19:50.861ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
39202024-08-16T07:19:50.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
39212024-08-16T07:19:50.861ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-08-16 07:09:50.856785318 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
39222024-08-16T07:19:50.861ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 5.097498ms iteration = 4 status = {"expiration":"2024-08-16T07:09:50.856785318Z","pruned":[]}
39232024-08-16T07:19:50.861ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1254, tv_nsec: 237903255 } })
39242024-08-16T07:19:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
39252024-08-16T07:19:50.862ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
39262024-08-16T07:19:50.862ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 7 reason = Timeout
39272024-08-16T07:19:50.862ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
39282024-08-16T07:19:50.862ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
39292024-08-16T07:19:50.862ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 4 reason = Timeout
39302024-08-16T07:19:50.862ZINFOnexus (BackgroundTasks): Abandoned VMM reaper running background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:76
39312024-08-16T07:19:50.862ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
39322024-08-16T07:19:50.862ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 19 reason = Timeout
39332024-08-16T07:19:50.862ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
39342024-08-16T07:19:50.862ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39352024-08-16T07:19:50.862ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 6 reason = Timeout
39362024-08-16T07:19:50.862ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 7 reason = Timeout
39372024-08-16T07:19:50.862ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39382024-08-16T07:19:50.862ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 7 reason = Timeout
39392024-08-16T07:19:50.862ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39402024-08-16T07:19:50.862ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 7 reason = Timeout
39412024-08-16T07:19:50.862ZINFOnexus (BackgroundTasks): region snapshot replacement start task started background_task = region_snapshot_replacement_start file = nexus/src/app/background/tasks/region_snapshot_replacement_start.rs:236
39422024-08-16T07:19:50.862ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
39432024-08-16T07:19:50.862ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 7 reason = Timeout
39442024-08-16T07:19:50.862ZWARNnexus (BackgroundTasks): region replacement task started background_task = region_replacement file = nexus/src/app/background/tasks/region_replacement.rs:64
39452024-08-16T07:19:50.862ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
39462024-08-16T07:19:50.862ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 7 reason = Timeout
39472024-08-16T07:19:50.862ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39482024-08-16T07:19:50.862ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 7 reason = Timeout
39492024-08-16T07:19:50.862ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
39502024-08-16T07:19:50.862ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 4 reason = Timeout
39512024-08-16T07:19:50.862ZINFOnexus (BackgroundTasks): lookup region port task started background_task = lookup_region_port file = nexus/src/app/background/tasks/lookup_region_port.rs:56
39522024-08-16T07:19:50.862ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
39532024-08-16T07:19:50.862ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 7 reason = Timeout
39542024-08-16T07:19:50.862ZINFOnexus (BackgroundTasks): region snapshot replacement garbage collect task started background_task = region_snapshot_replacement_garbage_collection file = nexus/src/app/background/tasks/region_snapshot_replacement_garbage_collect.rs:133
39552024-08-16T07:19:50.862ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
39562024-08-16T07:19:50.862ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 7 reason = Timeout
39572024-08-16T07:19:50.862ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
39582024-08-16T07:19:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
39592024-08-16T07:19:50.862ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
39602024-08-16T07:19:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
39612024-08-16T07:19:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39622024-08-16T07:19:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
39632024-08-16T07:19:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39642024-08-16T07:19:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
39652024-08-16T07:19:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39662024-08-16T07:19:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
39672024-08-16T07:19:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
39682024-08-16T07:19:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
39692024-08-16T07:19:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
39702024-08-16T07:19:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39712024-08-16T07:19:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
39722024-08-16T07:19:50.863ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39732024-08-16T07:19:50.863ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
39742024-08-16T07:19:50.863ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39752024-08-16T07:19:50.863ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
39762024-08-16T07:19:50.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39772024-08-16T07:19:50.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
39782024-08-16T07:19:50.864ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
39792024-08-16T07:19:50.864ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39802024-08-16T07:19:50.864ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39812024-08-16T07:19:50.864ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
39822024-08-16T07:19:50.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39832024-08-16T07:19:50.865ZWARNnexus (BackgroundTasks): physical disk adoption task started background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:100
39842024-08-16T07:19:50.865ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39852024-08-16T07:19:50.865ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39862024-08-16T07:19:50.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39872024-08-16T07:19:50.865ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
39882024-08-16T07:19:50.865ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
39892024-08-16T07:19:50.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39902024-08-16T07:19:50.865ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
39912024-08-16T07:19:50.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
39922024-08-16T07:19:50.865ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39932024-08-16T07:19:50.866ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
39942024-08-16T07:19:50.866ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
39952024-08-16T07:19:50.866ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
39962024-08-16T07:19:50.866ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
39972024-08-16T07:19:50.866ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39982024-08-16T07:19:50.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
39992024-08-16T07:19:50.866ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
40002024-08-16T07:19:50.866ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
40012024-08-16T07:19:50.866ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 8.994578ms iteration = 4 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
40022024-08-16T07:19:50.866ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
40032024-08-16T07:19:50.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
40042024-08-16T07:19:50.867ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40052024-08-16T07:19:50.867ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
40062024-08-16T07:19:50.867ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
40072024-08-16T07:19:50.867ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
40082024-08-16T07:19:50.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
40092024-08-16T07:19:50.867ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
40102024-08-16T07:19:50.867ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40112024-08-16T07:19:50.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
40122024-08-16T07:19:50.868ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
40132024-08-16T07:19:50.868ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 5.835204ms iteration = 19 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
40142024-08-16T07:19:50.868ZINFOnexus (BackgroundTasks): lookup region port task done background_task = lookup_region_port file = nexus/src/app/background/tasks/lookup_region_port.rs:150
40152024-08-16T07:19:50.868ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 6.183473ms iteration = 4 status = {"errors":[],"found_port_ok":[]}
40162024-08-16T07:19:50.868ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
40172024-08-16T07:19:50.868ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
40182024-08-16T07:19:50.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
40192024-08-16T07:19:50.869ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40202024-08-16T07:19:50.869ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
40212024-08-16T07:19:50.869ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
40222024-08-16T07:19:50.869ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
40232024-08-16T07:19:50.869ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
40242024-08-16T07:19:50.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
40252024-08-16T07:19:50.870ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
40262024-08-16T07:19:50.870ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
40272024-08-16T07:19:50.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
40282024-08-16T07:19:50.870ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
40292024-08-16T07:19:50.870ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
40302024-08-16T07:19:50.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
40312024-08-16T07:19:50.871ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
40322024-08-16T07:19:50.871ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40332024-08-16T07:19:50.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40342024-08-16T07:19:50.872ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40352024-08-16T07:19:50.873ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40362024-08-16T07:19:50.875ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
40372024-08-16T07:19:50.875ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
40382024-08-16T07:19:50.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
40392024-08-16T07:19:50.876ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40402024-08-16T07:19:50.877ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
40412024-08-16T07:19:50.877ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
40422024-08-16T07:19:50.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
40432024-08-16T07:19:50.877ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
40442024-08-16T07:19:50.877ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
40452024-08-16T07:19:50.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
40462024-08-16T07:19:50.880ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40472024-08-16T07:19:50.880ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
40482024-08-16T07:19:50.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
40492024-08-16T07:19:50.881ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
40502024-08-16T07:19:50.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
40512024-08-16T07:19:50.881ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
40522024-08-16T07:19:50.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
40532024-08-16T07:19:50.882ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40542024-08-16T07:19:50.882ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
40552024-08-16T07:19:50.882ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
40562024-08-16T07:19:50.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
40572024-08-16T07:19:50.882ZWARNnexus (BackgroundTasks): region replacement task done background_task = region_replacement file = nexus/src/app/background/tasks/region_replacement.rs:185
40582024-08-16T07:19:50.882ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 20.437612ms iteration = 7 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
40592024-08-16T07:19:50.883ZINFOnexus (BackgroundTasks): region snapshot replacement start task done background_task = region_snapshot_replacement_start file = nexus/src/app/background/tasks/region_snapshot_replacement_start.rs:252
40602024-08-16T07:19:50.883ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 21.065596ms iteration = 7 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
40612024-08-16T07:19:50.884ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40622024-08-16T07:19:50.884ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
40632024-08-16T07:19:50.884ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = ddebb22e-3faa-4936-9b3e-0f4d28827c0e dns_zone_name = oxide.test found_so_far = 0 version = 2
40642024-08-16T07:19:50.884ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
40652024-08-16T07:19:50.884ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
40662024-08-16T07:19:50.884ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
40672024-08-16T07:19:50.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
40682024-08-16T07:19:50.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
40692024-08-16T07:19:50.885ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40702024-08-16T07:19:50.886ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
40712024-08-16T07:19:50.886ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40722024-08-16T07:19:50.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40732024-08-16T07:19:50.886ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40742024-08-16T07:19:50.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40752024-08-16T07:19:50.887ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1254, tv_nsec: 263714872 } })
40762024-08-16T07:19:50.888ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
40772024-08-16T07:19:50.889ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
40782024-08-16T07:19:50.889ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
40792024-08-16T07:19:50.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
40802024-08-16T07:19:50.890ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
40812024-08-16T07:19:50.890ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 27.789462ms iteration = 7 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
40822024-08-16T07:19:50.890ZWARNnexus (BackgroundTasks): physical disk adoption task done background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:174
40832024-08-16T07:19:50.890ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 33.193857ms iteration = 9 status = {"physical_disks_added":0}
40842024-08-16T07:19:50.891ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40852024-08-16T07:19:50.891ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40862024-08-16T07:19:50.893ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
40872024-08-16T07:19:50.893ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40882024-08-16T07:19:50.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40892024-08-16T07:19:50.893ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40902024-08-16T07:19:50.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40912024-08-16T07:19:50.894ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
40922024-08-16T07:19:50.894ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40932024-08-16T07:19:50.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40942024-08-16T07:19:50.894ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40952024-08-16T07:19:50.895ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = ddebb22e-3faa-4936-9b3e-0f4d28827c0e dns_zone_name = oxide.test found_so_far = 1 version = 2
40962024-08-16T07:19:50.895ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
40972024-08-16T07:19:50.895ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-08-16 07:16:55.724690 UTC dns_group = external generation = 2
40982024-08-16T07:19:50.895ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 38.723465ms iteration = 4 status = {"generation":2}
40992024-08-16T07:19:50.895ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
41002024-08-16T07:19:50.895ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41012024-08-16T07:19:50.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41022024-08-16T07:19:50.901ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
41032024-08-16T07:19:50.901ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 44.288453ms iteration = 19 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
41042024-08-16T07:19:50.901ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 44.444747ms iteration = 3 status = {"nsuccess":5}
41052024-08-16T07:19:50.903ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
41062024-08-16T07:19:50.903ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
41072024-08-16T07:19:50.903ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
41082024-08-16T07:19:50.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
41092024-08-16T07:19:50.905ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
41102024-08-16T07:19:50.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
41112024-08-16T07:19:50.906ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41122024-08-16T07:19:50.907ZINFOnexus (BackgroundTasks): region snapshot replacement garbage collect task done background_task = region_snapshot_replacement_garbage_collection file = nexus/src/app/background/tasks/region_snapshot_replacement_garbage_collect.rs:147
41132024-08-16T07:19:50.907ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 45.167714ms iteration = 7 status = {"errors":[],"garbage_collect_requested":[]}
41142024-08-16T07:19:50.907ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
41152024-08-16T07:19:50.907ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
41162024-08-16T07:19:50.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
41172024-08-16T07:19:50.908ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41182024-08-16T07:19:50.909ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
41192024-08-16T07:19:50.909ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 2c55b660-f328-498e-b44c-73da75015ed4 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
41202024-08-16T07:19:50.909ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
41212024-08-16T07:19:50.909ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
41222024-08-16T07:19:50.909ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
41232024-08-16T07:19:50.909ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 47.505007ms iteration = 4 status = {"error":null,"error_count":0,"found":0,"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0}
41242024-08-16T07:19:50.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
41252024-08-16T07:19:50.910ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
41262024-08-16T07:19:50.910ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
41272024-08-16T07:19:50.910ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41282024-08-16T07:19:50.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
41292024-08-16T07:19:50.914ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
41302024-08-16T07:19:50.914ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
41312024-08-16T07:19:50.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
41322024-08-16T07:19:50.916ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 2c55b660-f328-498e-b44c-73da75015ed4 dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
41332024-08-16T07:19:50.916ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
41342024-08-16T07:19:50.916ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-08-16 07:16:55.302318 UTC dns_group = internal generation = 1
41352024-08-16T07:19:50.916ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 59.410442ms iteration = 4 status = {"generation":1}
41362024-08-16T07:19:50.929ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-08-16T07:16:49.943339Z, time_modified: 2024-08-16T07:16:49.943339Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, db_silo: Silo { identity: SiloIdentity { id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-16T07:16:55.682566Z, time_modified: 2024-08-16T07:16:55.682566Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "c9e400628d2b58a74b998fbfa44a053952e83a6e8d3c49e6518981bf7d4a006f" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, db_silo: Silo { identity: SiloIdentity { id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-16T07:16:55.682566Z, time_modified: 2024-08-16T07:16:55.682566Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "c9e400628d2b58a74b998fbfa44a053952e83a6e8d3c49e6518981bf7d4a006f" }] }) }
41372024-08-16T07:19:50.929ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 73.107548ms iteration = 4 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071","tls_certs":["c9e400628d2b58a74b998fbfa44a053952e83a6e8d3c49e6518981bf7d4a006f"]}},"default_endpoint":{"silo_id":"439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071","tls_certs":["c9e400628d2b58a74b998fbfa44a053952e83a6e8d3c49e6518981bf7d4a006f"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
41382024-08-16T07:19:50.937ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
41392024-08-16T07:19:50.937ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
41402024-08-16T07:19:50.937ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 75.164796ms iteration = 7 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
41412024-08-16T07:19:51.017ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
41422024-08-16T07:19:51.017ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
41432024-08-16T07:19:51.018ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "43717f67-2a86-4fc6-83a2-03311151fdfb", "content-length": "26", "date": "Fri, 16 Aug 2024 07:19:51 GMT"} })
41442024-08-16T07:19:51.018ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
41452024-08-16T07:19:51.019ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
41462024-08-16T07:19:51.020ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
41472024-08-16T07:19:51.089ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
41482024-08-16T07:19:51.089ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
41492024-08-16T07:19:51.090ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "47c14119-483b-4f32-a22e-9fdf863ce139", "content-length": "26", "date": "Fri, 16 Aug 2024 07:19:51 GMT"} })
41502024-08-16T07:19:51.090ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
41512024-08-16T07:19:51.091ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
41522024-08-16T07:19:51.143ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
41532024-08-16T07:19:51.160ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
41542024-08-16T07:19:51.161ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "aacd11e5-932d-4398-ab7f-a80c33f0ae21", "content-length": "691", "date": "Fri, 16 Aug 2024 07:19:51 GMT"} })
41552024-08-16T07:19:51.161ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
41562024-08-16T07:19:51.161ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
41572024-08-16T07:19:51.161ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
41582024-08-16T07:19:51.161ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 299.582849ms iteration = 7 status = {}
41592024-08-16T07:19:51.166ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
41602024-08-16T07:19:51.167ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "1d1ec683-aa6d-4360-b007-293ca61df086", "content-length": "372", "date": "Fri, 16 Aug 2024 07:19:51 GMT"} })
41612024-08-16T07:19:51.167ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41622024-08-16T07:19:51.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41632024-08-16T07:19:51.169ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41642024-08-16T07:19:51.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41652024-08-16T07:19:51.172ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41662024-08-16T07:19:51.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41672024-08-16T07:19:51.174ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
41682024-08-16T07:19:51.174ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "73d92fe1-dfec-49a3-bf7d-1b0d8eb30470", "date": "Fri, 16 Aug 2024 07:19:51 GMT"} })
41692024-08-16T07:19:51.176ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 313.748806ms iteration = 7 status = {}
41702024-08-16T07:19:51.181ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
41712024-08-16T07:19:51.181ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41722024-08-16T07:19:51.182ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "5bb5fe2a-f4fb-4bb6-ac55-16f58eb03b96", "date": "Fri, 16 Aug 2024 07:19:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
41732024-08-16T07:19:51.182ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
41742024-08-16T07:19:51.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41752024-08-16T07:19:51.183ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41762024-08-16T07:19:51.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41772024-08-16T07:19:51.184ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "3bee4102-5ced-4937-893d-33d70c5634d2", "date": "Fri, 16 Aug 2024 07:19:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
41782024-08-16T07:19:51.184ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
41792024-08-16T07:19:51.184ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41802024-08-16T07:19:51.187ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
41812024-08-16T07:19:51.187ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 324.74619ms iteration = 6 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
41822024-08-16T07:19:51.187ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae, lookup_type: ById(03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae) } result = Ok(())
41832024-08-16T07:19:51.187ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41842024-08-16T07:19:51.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41852024-08-16T07:19:51.189ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 326.776527ms iteration = 7 status = 0
41862024-08-16T07:19:51.255ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
41872024-08-16T07:19:51.255ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "63b42a8c-86fd-4e46-8b0b-9fd22a187b9c", "content-length": "1", "date": "Fri, 16 Aug 2024 07:19:50 GMT"} })
41882024-08-16T07:19:51.257ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
41892024-08-16T07:19:51.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
41902024-08-16T07:19:51.259ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 402.363962ms iteration = 7 status = null
41912024-08-16T07:19:51.289ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a zone_address = fd00:1122:3344:101::2
41922024-08-16T07:19:51.289ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
41932024-08-16T07:19:51.289ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "87d7307c-5956-4d7d-9c59-321d8836e9e9", "content-length": "26", "date": "Fri, 16 Aug 2024 07:19:51 GMT"} })
41942024-08-16T07:19:51.289ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
41952024-08-16T07:19:51.291ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
41962024-08-16T07:19:51.348ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 491.932931ms iteration = 7 status = {}
41972024-08-16T07:19:51.362ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
41982024-08-16T07:19:51.381ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 22b7982f-97c1-4d1b-a2d7-c52202f3d8f6 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
41992024-08-16T07:19:51.382ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 22b7982f-97c1-4d1b-a2d7-c52202f3d8f6 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
42002024-08-16T07:19:51.383ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1985 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 22b7982f-97c1-4d1b-a2d7-c52202f3d8f6 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
42012024-08-16T07:19:51.425ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
42022024-08-16T07:19:51.426ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "65a5eb2a-13ff-4d88-a2d2-050aa65bc48a", "date": "Fri, 16 Aug 2024 07:19:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
42032024-08-16T07:19:51.426ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
42042024-08-16T07:19:51.428ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "6df1a7ff-b6b0-4ccd-b1b2-fd50afd71b1d", "date": "Fri, 16 Aug 2024 07:19:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
42052024-08-16T07:19:51.428ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
42062024-08-16T07:19:51.429ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "3aff7f18-a4fa-494e-b883-f67b813f7fa6", "date": "Fri, 16 Aug 2024 07:19:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
42072024-08-16T07:19:51.429ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
42082024-08-16T07:19:51.430ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
42092024-08-16T07:19:51.430ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 574.221212ms iteration = 6 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
42102024-08-16T07:19:51.480ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42112024-08-16T07:19:51.480ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42122024-08-16T07:19:51.481ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:146 port = SwitchPort { id: f13c0939-2c9d-4a0d-b006-5f3de89cc4fc, rack_id: e1b0d583-7b20-4a4b-97f9-9f83300aeb7a, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(4de7fcf8-2b1f-4b0e-ba6f-584e8a34addb) } rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0
42132024-08-16T07:19:51.481ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42142024-08-16T07:19:51.482ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42152024-08-16T07:19:51.488ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
42162024-08-16T07:19:51.489ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "3b76f024-60ec-4d73-bfd1-d0c14b1c63d6", "content-length": "121", "date": "Fri, 16 Aug 2024 07:19:50 GMT"} })
42172024-08-16T07:19:51.489ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1663 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
42182024-08-16T07:19:51.489ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1690 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 4de7fcf8-2b1f-4b0e-ba6f-584e8a34addb
42192024-08-16T07:19:51.489ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None)}}
42202024-08-16T07:19:51.489ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None)}}
42212024-08-16T07:19:51.489ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {}
42222024-08-16T07:19:51.489ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {}
42232024-08-16T07:19:51.489ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
42242024-08-16T07:19:51.489ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42252024-08-16T07:19:51.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42262024-08-16T07:19:51.491ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
42272024-08-16T07:19:51.492ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6e27cfb0-f5b7-490c-9658-9571b1de6fb6", "content-length": "2", "date": "Fri, 16 Aug 2024 07:19:50 GMT"} })
42282024-08-16T07:19:51.492ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
42292024-08-16T07:19:51.492ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "71d2ba59-ee8e-466c-a7e3-a2f69c5f1501", "content-length": "52", "date": "Fri, 16 Aug 2024 07:19:50 GMT"} })
42302024-08-16T07:19:51.492ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0
42312024-08-16T07:19:51.492ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
42322024-08-16T07:19:51.505ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 712 local_addr = [fd00:1122:3344:101::c]:53719 method = GET remote_addr = [fd00:1122:3344:101::d]:60737 req_id = 2e1856e1-a0e8-4195-b6d1-f69a1e4ecf40 response_code = 200 uri = /0d900881-9285-4dbf-910f-5e4676c8f133
42332024-08-16T07:19:51.546ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "ba6d9320-bbc5-4801-8562-33ab9622fcb6", "date": "Fri, 16 Aug 2024 07:19:51 GMT"} })
42342024-08-16T07:19:51.546ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch = Switch0
42352024-08-16T07:19:51.546ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
42362024-08-16T07:19:51.547ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ec0785a4-f777-4c7a-a4cf-1c7ba4c82ee8", "content-length": "494", "date": "Fri, 16 Aug 2024 07:19:51 GMT"} })
42372024-08-16T07:19:51.547ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42382024-08-16T07:19:51.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42392024-08-16T07:19:51.550ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42402024-08-16T07:19:51.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42412024-08-16T07:19:51.553ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42422024-08-16T07:19:51.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42432024-08-16T07:19:51.554ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42442024-08-16T07:19:51.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42452024-08-16T07:19:51.561ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 698.626745ms iteration = 7 status = {}
42462024-08-16T07:19:51.831ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64556 req_id = ff1abd1c-9eea-4e2f-a575-acf57355de3d roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
42472024-08-16T07:19:51.831ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64556 req_id = ff1abd1c-9eea-4e2f-a575-acf57355de3d resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
42482024-08-16T07:19:51.833ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2327 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64556 req_id = ff1abd1c-9eea-4e2f-a575-acf57355de3d response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
42492024-08-16T07:19:52.409ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = e56d5393-0869-4363-9fbe-205d5adfaa11 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
42502024-08-16T07:19:52.410ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = e56d5393-0869-4363-9fbe-205d5adfaa11 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
42512024-08-16T07:19:52.411ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2107 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = e56d5393-0869-4363-9fbe-205d5adfaa11 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
42522024-08-16T07:19:53.430ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = a9feeb8d-2a36-4ee8-a705-256966f51cd3 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
42532024-08-16T07:19:53.431ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = a9feeb8d-2a36-4ee8-a705-256966f51cd3 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
42542024-08-16T07:19:53.432ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1914 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = a9feeb8d-2a36-4ee8-a705-256966f51cd3 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
42552024-08-16T07:19:54.453ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 649ea16e-036b-4c20-8686-0780ca5ebab1 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
42562024-08-16T07:19:54.453ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 649ea16e-036b-4c20-8686-0780ca5ebab1 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
42572024-08-16T07:19:54.454ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2474 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 649ea16e-036b-4c20-8686-0780ca5ebab1 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
42582024-08-16T07:19:55.474ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = b1341ce7-1ba4-48b9-be31-967a3324c894 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
42592024-08-16T07:19:55.474ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = b1341ce7-1ba4-48b9-be31-967a3324c894 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
42602024-08-16T07:19:55.476ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2120 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = b1341ce7-1ba4-48b9-be31-967a3324c894 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
42612024-08-16T07:19:56.496ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = fe7e5dd9-80af-448b-b7aa-b2b9ecc6f799 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
42622024-08-16T07:19:56.496ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = fe7e5dd9-80af-448b-b7aa-b2b9ecc6f799 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
42632024-08-16T07:19:56.498ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2044 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = fe7e5dd9-80af-448b-b7aa-b2b9ecc6f799 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
42642024-08-16T07:19:57.517ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 2ee74c3b-ce98-4895-8aa8-026a8a63e01d roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
42652024-08-16T07:19:57.517ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 2ee74c3b-ce98-4895-8aa8-026a8a63e01d resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
42662024-08-16T07:19:57.519ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1861 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 2ee74c3b-ce98-4895-8aa8-026a8a63e01d response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
42672024-08-16T07:19:58.538ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = aba5c3f4-e5f6-4fdd-ba29-da186bad288f roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
42682024-08-16T07:19:58.538ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = aba5c3f4-e5f6-4fdd-ba29-da186bad288f resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
42692024-08-16T07:19:58.540ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1946 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = aba5c3f4-e5f6-4fdd-ba29-da186bad288f response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
42702024-08-16T07:19:59.559ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 5460146f-d826-4e97-8bd8-678f878a07c2 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
42712024-08-16T07:19:59.559ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 5460146f-d826-4e97-8bd8-678f878a07c2 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
42722024-08-16T07:19:59.561ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2115 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 5460146f-d826-4e97-8bd8-678f878a07c2 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
42732024-08-16T07:20:00.580ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = ebb947e4-08f0-463f-b0d4-d6cbe87d55ef roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
42742024-08-16T07:20:00.581ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = ebb947e4-08f0-463f-b0d4-d6cbe87d55ef resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
42752024-08-16T07:20:00.582ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2670 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = ebb947e4-08f0-463f-b0d4-d6cbe87d55ef response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
42762024-08-16T07:20:00.856ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 20 reason = Timeout
42772024-08-16T07:20:00.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42782024-08-16T07:20:00.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42792024-08-16T07:20:00.858ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42802024-08-16T07:20:00.860ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
42812024-08-16T07:20:00.860ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42822024-08-16T07:20:00.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42832024-08-16T07:20:00.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42842024-08-16T07:20:00.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42852024-08-16T07:20:00.862ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 20 reason = Timeout
42862024-08-16T07:20:00.862ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
42872024-08-16T07:20:00.862ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42882024-08-16T07:20:00.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42892024-08-16T07:20:00.862ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42902024-08-16T07:20:00.863ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42912024-08-16T07:20:00.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42922024-08-16T07:20:00.865ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
42932024-08-16T07:20:00.865ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42942024-08-16T07:20:00.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42952024-08-16T07:20:00.865ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
42962024-08-16T07:20:00.865ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.141513ms iteration = 20 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
42972024-08-16T07:20:00.870ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
42982024-08-16T07:20:00.870ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 13.987192ms iteration = 20 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
42992024-08-16T07:20:01.505ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 627 local_addr = [fd00:1122:3344:101::c]:53719 method = GET remote_addr = [fd00:1122:3344:101::d]:60737 req_id = cd5f9853-cd59-4df8-9951-7d7d4072e365 response_code = 200 uri = /0d900881-9285-4dbf-910f-5e4676c8f133
43002024-08-16T07:20:01.602ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = df40a8ec-d9cd-42d7-8d2f-4992e57b69da roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
43012024-08-16T07:20:01.602ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = df40a8ec-d9cd-42d7-8d2f-4992e57b69da resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
43022024-08-16T07:20:01.604ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1672 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = df40a8ec-d9cd-42d7-8d2f-4992e57b69da response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
43032024-08-16T07:20:02.623ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 7ab380bd-6278-4710-aa7d-c0e36940e14e roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
43042024-08-16T07:20:02.624ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 7ab380bd-6278-4710-aa7d-c0e36940e14e resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
43052024-08-16T07:20:02.625ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1819 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 7ab380bd-6278-4710-aa7d-c0e36940e14e response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
43062024-08-16T07:20:03.645ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 2b48d354-6e85-4fa6-9160-a56375811cba roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
43072024-08-16T07:20:03.646ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 2b48d354-6e85-4fa6-9160-a56375811cba resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
43082024-08-16T07:20:03.647ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1820 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 2b48d354-6e85-4fa6-9160-a56375811cba response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
43092024-08-16T07:20:04.667ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 039b7eab-c942-4407-a7a7-5e856396cff4 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
43102024-08-16T07:20:04.668ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 039b7eab-c942-4407-a7a7-5e856396cff4 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
43112024-08-16T07:20:04.669ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1927 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 039b7eab-c942-4407-a7a7-5e856396cff4 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
43122024-08-16T07:20:05.687ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = e315201e-450c-4121-b11d-470f2139071e roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
43132024-08-16T07:20:05.687ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = e315201e-450c-4121-b11d-470f2139071e resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
43142024-08-16T07:20:05.689ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2074 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = e315201e-450c-4121-b11d-470f2139071e response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
43152024-08-16T07:20:06.707ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 9b54ee78-d816-4d10-ae8a-dd5a575b92d4 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
43162024-08-16T07:20:06.708ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 9b54ee78-d816-4d10-ae8a-dd5a575b92d4 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
43172024-08-16T07:20:06.709ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1792 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 9b54ee78-d816-4d10-ae8a-dd5a575b92d4 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
43182024-08-16T07:20:07.728ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = bfcda991-5e02-4e3c-88b9-1dec12f14b4b roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
43192024-08-16T07:20:07.729ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = bfcda991-5e02-4e3c-88b9-1dec12f14b4b resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
43202024-08-16T07:20:07.730ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1768 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = bfcda991-5e02-4e3c-88b9-1dec12f14b4b response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
43212024-08-16T07:20:08.749ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = e6ee06f4-1958-42cf-903a-b57c005b0bed roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
43222024-08-16T07:20:08.749ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = e6ee06f4-1958-42cf-903a-b57c005b0bed resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
43232024-08-16T07:20:08.751ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1859 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = e6ee06f4-1958-42cf-903a-b57c005b0bed response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
43242024-08-16T07:20:09.771ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = c0e4a1d5-41f6-4383-981f-ee5da25b4788 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
43252024-08-16T07:20:09.771ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = c0e4a1d5-41f6-4383-981f-ee5da25b4788 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
43262024-08-16T07:20:09.773ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2052 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = c0e4a1d5-41f6-4383-981f-ee5da25b4788 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
43272024-08-16T07:20:10.793ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = d5c11eb7-2353-4433-9ca9-b8348462a3a5 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
43282024-08-16T07:20:10.793ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = d5c11eb7-2353-4433-9ca9-b8348462a3a5 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
43292024-08-16T07:20:10.795ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2872 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = d5c11eb7-2353-4433-9ca9-b8348462a3a5 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
43302024-08-16T07:20:10.856ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 21 reason = Timeout
43312024-08-16T07:20:10.856ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43322024-08-16T07:20:10.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43332024-08-16T07:20:10.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43342024-08-16T07:20:10.860ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
43352024-08-16T07:20:10.860ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43362024-08-16T07:20:10.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43372024-08-16T07:20:10.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43382024-08-16T07:20:10.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43392024-08-16T07:20:10.862ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43402024-08-16T07:20:10.862ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 21 reason = Timeout
43412024-08-16T07:20:10.862ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
43422024-08-16T07:20:10.862ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43432024-08-16T07:20:10.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43442024-08-16T07:20:10.864ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43452024-08-16T07:20:10.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43462024-08-16T07:20:10.864ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
43472024-08-16T07:20:10.864ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43482024-08-16T07:20:10.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43492024-08-16T07:20:10.865ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
43502024-08-16T07:20:10.865ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.348688ms iteration = 21 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
43512024-08-16T07:20:10.870ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
43522024-08-16T07:20:10.870ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 14.254939ms iteration = 21 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
43532024-08-16T07:20:11.506ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 676 local_addr = [fd00:1122:3344:101::c]:53719 method = GET remote_addr = [fd00:1122:3344:101::d]:60737 req_id = e4abead2-82cc-4ab0-aace-3143386d8aa5 response_code = 200 uri = /0d900881-9285-4dbf-910f-5e4676c8f133
43542024-08-16T07:20:11.815ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 299a2851-f428-4977-b35b-33d7cdf49667 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
43552024-08-16T07:20:11.816ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 299a2851-f428-4977-b35b-33d7cdf49667 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
43562024-08-16T07:20:11.817ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1882 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 299a2851-f428-4977-b35b-33d7cdf49667 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
43572024-08-16T07:20:12.836ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 270efdb4-5f8e-4a19-adbb-33ae11df5f0a roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
43582024-08-16T07:20:12.836ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 270efdb4-5f8e-4a19-adbb-33ae11df5f0a resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
43592024-08-16T07:20:12.838ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1934 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 270efdb4-5f8e-4a19-adbb-33ae11df5f0a response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
43602024-08-16T07:20:13.858ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = e6687721-db7f-40cf-8c22-85fd08d8f0b1 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
43612024-08-16T07:20:13.858ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = e6687721-db7f-40cf-8c22-85fd08d8f0b1 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
43622024-08-16T07:20:13.860ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1563 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = e6687721-db7f-40cf-8c22-85fd08d8f0b1 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
43632024-08-16T07:20:14.881ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = a396b447-20e1-4c2d-8b52-7040740bf955 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
43642024-08-16T07:20:14.881ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = a396b447-20e1-4c2d-8b52-7040740bf955 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
43652024-08-16T07:20:14.883ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 3156 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = a396b447-20e1-4c2d-8b52-7040740bf955 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
43662024-08-16T07:20:15.903ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = eeb1d8c7-9764-43c5-a249-5b1796cc6b3d roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
43672024-08-16T07:20:15.904ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = eeb1d8c7-9764-43c5-a249-5b1796cc6b3d resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
43682024-08-16T07:20:15.905ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2166 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = eeb1d8c7-9764-43c5-a249-5b1796cc6b3d response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
43692024-08-16T07:20:16.924ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 01516a3e-8957-4d5a-9c57-a0b02d6b3ba1 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
43702024-08-16T07:20:16.925ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 01516a3e-8957-4d5a-9c57-a0b02d6b3ba1 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
43712024-08-16T07:20:16.926ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2232 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 01516a3e-8957-4d5a-9c57-a0b02d6b3ba1 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
43722024-08-16T07:20:17.947ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 83ebdc95-9829-4fdd-a464-ddf3a01078bb roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
43732024-08-16T07:20:17.947ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 83ebdc95-9829-4fdd-a464-ddf3a01078bb resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
43742024-08-16T07:20:17.949ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2603 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 83ebdc95-9829-4fdd-a464-ddf3a01078bb response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
43752024-08-16T07:20:18.968ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = e874cad3-e55a-4d64-b738-f60455505141 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
43762024-08-16T07:20:18.968ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = e874cad3-e55a-4d64-b738-f60455505141 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
43772024-08-16T07:20:18.969ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1838 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = e874cad3-e55a-4d64-b738-f60455505141 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
43782024-08-16T07:20:19.989ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 0fb73739-cfda-4286-ac4d-3668733893f4 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
43792024-08-16T07:20:19.990ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 0fb73739-cfda-4286-ac4d-3668733893f4 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
43802024-08-16T07:20:19.991ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1907 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 0fb73739-cfda-4286-ac4d-3668733893f4 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
43812024-08-16T07:20:20.856ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 8 reason = Timeout
43822024-08-16T07:20:20.856ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
43832024-08-16T07:20:20.856ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 8 reason = Timeout
43842024-08-16T07:20:20.856ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 8 reason = Timeout
43852024-08-16T07:20:20.856ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
43862024-08-16T07:20:20.856ZWARNnexus (BackgroundTasks): phantom disk task started background_task = phantom_disks file = nexus/src/app/background/tasks/phantom_disks.rs:46
43872024-08-16T07:20:20.856ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 22 reason = Timeout
43882024-08-16T07:20:20.856ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43892024-08-16T07:20:20.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
43902024-08-16T07:20:20.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
43912024-08-16T07:20:20.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43922024-08-16T07:20:20.857ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 10 reason = Timeout
43932024-08-16T07:20:20.857ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
43942024-08-16T07:20:20.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
43952024-08-16T07:20:20.858ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43962024-08-16T07:20:20.859ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1284, tv_nsec: 235338083 } })
43972024-08-16T07:20:20.859ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43982024-08-16T07:20:20.859ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1284, tv_nsec: 235496397 } })
43992024-08-16T07:20:20.859ZWARNnexus (BackgroundTasks): phantom disk task done background_task = phantom_disks file = nexus/src/app/background/tasks/phantom_disks.rs:93
44002024-08-16T07:20:20.859ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.278246ms iteration = 8 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
44012024-08-16T07:20:20.860ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
44022024-08-16T07:20:20.861ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
44032024-08-16T07:20:20.861ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
44042024-08-16T07:20:20.861ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
44052024-08-16T07:20:20.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44062024-08-16T07:20:20.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
44072024-08-16T07:20:20.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44082024-08-16T07:20:20.861ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
44092024-08-16T07:20:20.862ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 8 reason = Timeout
44102024-08-16T07:20:20.862ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 22 reason = Timeout
44112024-08-16T07:20:20.862ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
44122024-08-16T07:20:20.862ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
44132024-08-16T07:20:20.862ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44142024-08-16T07:20:20.862ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 8 reason = Timeout
44152024-08-16T07:20:20.862ZINFOnexus (BackgroundTasks): region snapshot replacement garbage collect task started background_task = region_snapshot_replacement_garbage_collection file = nexus/src/app/background/tasks/region_snapshot_replacement_garbage_collect.rs:133
44162024-08-16T07:20:20.862ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
44172024-08-16T07:20:20.862ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 8 reason = Timeout
44182024-08-16T07:20:20.862ZINFOnexus (BackgroundTasks): region snapshot replacement start task started background_task = region_snapshot_replacement_start file = nexus/src/app/background/tasks/region_snapshot_replacement_start.rs:236
44192024-08-16T07:20:20.862ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
44202024-08-16T07:20:20.862ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 8 reason = Timeout
44212024-08-16T07:20:20.862ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44222024-08-16T07:20:20.862ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 8 reason = Timeout
44232024-08-16T07:20:20.862ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44242024-08-16T07:20:20.862ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 8 reason = Timeout
44252024-08-16T07:20:20.862ZWARNnexus (BackgroundTasks): region replacement task started background_task = region_replacement file = nexus/src/app/background/tasks/region_replacement.rs:64
44262024-08-16T07:20:20.862ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
44272024-08-16T07:20:20.862ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 8 reason = Timeout
44282024-08-16T07:20:20.862ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 8 reason = Timeout
44292024-08-16T07:20:20.862ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44302024-08-16T07:20:20.862ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
44312024-08-16T07:20:20.862ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
44322024-08-16T07:20:20.862ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 8 reason = Timeout
44332024-08-16T07:20:20.862ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
44342024-08-16T07:20:20.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
44352024-08-16T07:20:20.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
44362024-08-16T07:20:20.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44372024-08-16T07:20:20.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44382024-08-16T07:20:20.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44392024-08-16T07:20:20.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
44402024-08-16T07:20:20.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44412024-08-16T07:20:20.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
44422024-08-16T07:20:20.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
44432024-08-16T07:20:20.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
44442024-08-16T07:20:20.862ZWARNnexus (BackgroundTasks): physical disk adoption task started background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:100
44452024-08-16T07:20:20.862ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
44462024-08-16T07:20:20.863ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44472024-08-16T07:20:20.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
44482024-08-16T07:20:20.863ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44492024-08-16T07:20:20.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44502024-08-16T07:20:20.863ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44512024-08-16T07:20:20.863ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44522024-08-16T07:20:20.864ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44532024-08-16T07:20:20.864ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44542024-08-16T07:20:20.864ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44552024-08-16T07:20:20.865ZINFOnexus (BackgroundTasks): region snapshot replacement garbage collect task done background_task = region_snapshot_replacement_garbage_collection file = nexus/src/app/background/tasks/region_snapshot_replacement_garbage_collect.rs:147
44562024-08-16T07:20:20.865ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 2.931888ms iteration = 8 status = {"errors":[],"garbage_collect_requested":[]}
44572024-08-16T07:20:20.865ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44582024-08-16T07:20:20.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44592024-08-16T07:20:20.866ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
44602024-08-16T07:20:20.866ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
44612024-08-16T07:20:20.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
44622024-08-16T07:20:20.866ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
44632024-08-16T07:20:20.866ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
44642024-08-16T07:20:20.866ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.463873ms iteration = 22 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
44652024-08-16T07:20:20.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
44662024-08-16T07:20:20.867ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
44672024-08-16T07:20:20.867ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
44682024-08-16T07:20:20.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
44692024-08-16T07:20:20.867ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
44702024-08-16T07:20:20.867ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44712024-08-16T07:20:20.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44722024-08-16T07:20:20.867ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
44732024-08-16T07:20:20.867ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44742024-08-16T07:20:20.868ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
44752024-08-16T07:20:20.868ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44762024-08-16T07:20:20.868ZWARNnexus (BackgroundTasks): region replacement task done background_task = region_replacement file = nexus/src/app/background/tasks/region_replacement.rs:185
44772024-08-16T07:20:20.868ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 5.759463ms iteration = 8 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
44782024-08-16T07:20:20.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44792024-08-16T07:20:20.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44802024-08-16T07:20:20.868ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44812024-08-16T07:20:20.868ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
44822024-08-16T07:20:20.868ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44832024-08-16T07:20:20.868ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
44842024-08-16T07:20:20.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44852024-08-16T07:20:20.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
44862024-08-16T07:20:20.869ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1284, tv_nsec: 245989419 } })
44872024-08-16T07:20:20.869ZINFOnexus (BackgroundTasks): region snapshot replacement start task done background_task = region_snapshot_replacement_start file = nexus/src/app/background/tasks/region_snapshot_replacement_start.rs:252
44882024-08-16T07:20:20.869ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 7.666797ms iteration = 8 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
44892024-08-16T07:20:20.870ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
44902024-08-16T07:20:20.870ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44912024-08-16T07:20:20.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44922024-08-16T07:20:20.870ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
44932024-08-16T07:20:20.870ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44942024-08-16T07:20:20.870ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
44952024-08-16T07:20:20.870ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
44962024-08-16T07:20:20.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
44972024-08-16T07:20:20.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44982024-08-16T07:20:20.871ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
44992024-08-16T07:20:20.871ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
45002024-08-16T07:20:20.871ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 9.665303ms iteration = 8 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
45012024-08-16T07:20:20.872ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
45022024-08-16T07:20:20.872ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
45032024-08-16T07:20:20.872ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 9.94764ms iteration = 8 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
45042024-08-16T07:20:20.874ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
45052024-08-16T07:20:20.874ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.71509ms iteration = 22 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
45062024-08-16T07:20:20.876ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
45072024-08-16T07:20:20.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45082024-08-16T07:20:20.881ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45092024-08-16T07:20:20.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45102024-08-16T07:20:20.883ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45112024-08-16T07:20:20.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45122024-08-16T07:20:20.883ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
45132024-08-16T07:20:20.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45142024-08-16T07:20:20.884ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45152024-08-16T07:20:20.884ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45162024-08-16T07:20:20.886ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
45172024-08-16T07:20:20.886ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
45182024-08-16T07:20:20.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45192024-08-16T07:20:20.886ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae, lookup_type: ById(03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae) } result = Ok(())
45202024-08-16T07:20:20.886ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45212024-08-16T07:20:20.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45222024-08-16T07:20:20.887ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45232024-08-16T07:20:20.887ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 25.464048ms iteration = 8 status = 0
45242024-08-16T07:20:20.888ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
45252024-08-16T07:20:20.888ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
45262024-08-16T07:20:20.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45272024-08-16T07:20:20.900ZWARNnexus (BackgroundTasks): physical disk adoption task done background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:174
45282024-08-16T07:20:20.900ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 42.737078ms iteration = 10 status = {"physical_disks_added":0}
45292024-08-16T07:20:21.010ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = fe1697cf-8b16-4265-998e-ca6b37a99014 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
45302024-08-16T07:20:21.011ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = fe1697cf-8b16-4265-998e-ca6b37a99014 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
45312024-08-16T07:20:21.012ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1657 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = fe1697cf-8b16-4265-998e-ca6b37a99014 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
45322024-08-16T07:20:21.018ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a zone_address = fd00:1122:3344:101::2
45332024-08-16T07:20:21.018ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
45342024-08-16T07:20:21.019ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "067f011b-11c1-4138-89f2-062edf003499", "content-length": "26", "date": "Fri, 16 Aug 2024 07:20:21 GMT"} })
45352024-08-16T07:20:21.019ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
45362024-08-16T07:20:21.020ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
45372024-08-16T07:20:21.107ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
45382024-08-16T07:20:21.107ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
45392024-08-16T07:20:21.108ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "58eb41fe-8911-42e7-8a1b-671df866b273", "content-length": "26", "date": "Fri, 16 Aug 2024 07:20:21 GMT"} })
45402024-08-16T07:20:21.108ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
45412024-08-16T07:20:21.109ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
45422024-08-16T07:20:21.121ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
45432024-08-16T07:20:21.121ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
45442024-08-16T07:20:21.121ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "9c6d94a9-6259-4e26-85a1-71c14c7d5566", "content-length": "26", "date": "Fri, 16 Aug 2024 07:20:21 GMT"} })
45452024-08-16T07:20:21.121ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
45462024-08-16T07:20:21.122ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
45472024-08-16T07:20:21.137ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
45482024-08-16T07:20:21.137ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6f338b0c-c16d-4a22-9d01-36d9906bb952", "content-length": "372", "date": "Fri, 16 Aug 2024 07:20:21 GMT"} })
45492024-08-16T07:20:21.137ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45502024-08-16T07:20:21.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45512024-08-16T07:20:21.139ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45522024-08-16T07:20:21.139ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45532024-08-16T07:20:21.142ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45542024-08-16T07:20:21.142ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45552024-08-16T07:20:21.144ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
45562024-08-16T07:20:21.144ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "e103afd8-a738-413a-b5e9-f2fe53978570", "date": "Fri, 16 Aug 2024 07:20:21 GMT"} })
45572024-08-16T07:20:21.146ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 283.908967ms iteration = 8 status = {}
45582024-08-16T07:20:21.148ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
45592024-08-16T07:20:21.148ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b388c4c5-03a3-4ce4-9bca-f9075157780e", "content-length": "691", "date": "Fri, 16 Aug 2024 07:20:21 GMT"} })
45602024-08-16T07:20:21.148ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
45612024-08-16T07:20:21.148ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
45622024-08-16T07:20:21.148ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
45632024-08-16T07:20:21.149ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 287.584352ms iteration = 8 status = {}
45642024-08-16T07:20:21.211ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 354.699602ms iteration = 8 status = {}
45652024-08-16T07:20:21.216ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
45662024-08-16T07:20:21.216ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "cd640643-7649-466e-bcbc-cc4a0ebb4323", "content-length": "1", "date": "Fri, 16 Aug 2024 07:20:20 GMT"} })
45672024-08-16T07:20:21.218ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
45682024-08-16T07:20:21.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
45692024-08-16T07:20:21.219ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 363.224809ms iteration = 8 status = null
45702024-08-16T07:20:21.255ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45712024-08-16T07:20:21.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45722024-08-16T07:20:21.257ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:146 port = SwitchPort { id: f13c0939-2c9d-4a0d-b006-5f3de89cc4fc, rack_id: e1b0d583-7b20-4a4b-97f9-9f83300aeb7a, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(4de7fcf8-2b1f-4b0e-ba6f-584e8a34addb) } rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0
45732024-08-16T07:20:21.257ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45742024-08-16T07:20:21.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45752024-08-16T07:20:21.265ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
45762024-08-16T07:20:21.265ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d995a4b3-fc63-4da6-9672-5858458b44f0", "content-length": "121", "date": "Fri, 16 Aug 2024 07:20:20 GMT"} })
45772024-08-16T07:20:21.265ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1663 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
45782024-08-16T07:20:21.265ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1690 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 4de7fcf8-2b1f-4b0e-ba6f-584e8a34addb
45792024-08-16T07:20:21.265ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None)}}
45802024-08-16T07:20:21.265ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None)}}
45812024-08-16T07:20:21.265ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {}
45822024-08-16T07:20:21.265ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {}
45832024-08-16T07:20:21.265ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
45842024-08-16T07:20:21.265ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45852024-08-16T07:20:21.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45862024-08-16T07:20:21.267ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
45872024-08-16T07:20:21.267ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "85156c0e-5d0d-41a6-81fb-6740e6546f90", "content-length": "2", "date": "Fri, 16 Aug 2024 07:20:20 GMT"} })
45882024-08-16T07:20:21.267ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
45892024-08-16T07:20:21.268ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ac902c00-7f17-43e3-869f-6075baaf084b", "content-length": "52", "date": "Fri, 16 Aug 2024 07:20:20 GMT"} })
45902024-08-16T07:20:21.268ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0
45912024-08-16T07:20:21.268ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
45922024-08-16T07:20:21.327ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "2a2a821e-f064-4c9a-bc73-3235d22274b0", "date": "Fri, 16 Aug 2024 07:20:21 GMT"} })
45932024-08-16T07:20:21.327ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch = Switch0
45942024-08-16T07:20:21.327ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
45952024-08-16T07:20:21.327ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "9b45955b-de6e-44ac-ae21-d986707a1dae", "content-length": "494", "date": "Fri, 16 Aug 2024 07:20:21 GMT"} })
45962024-08-16T07:20:21.327ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45972024-08-16T07:20:21.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45982024-08-16T07:20:21.329ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45992024-08-16T07:20:21.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46002024-08-16T07:20:21.331ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46012024-08-16T07:20:21.331ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46022024-08-16T07:20:21.333ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46032024-08-16T07:20:21.333ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46042024-08-16T07:20:21.339ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 477.085708ms iteration = 8 status = {}
46052024-08-16T07:20:21.469ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
46062024-08-16T07:20:21.469ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
46072024-08-16T07:20:21.499ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
46082024-08-16T07:20:21.499ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:52838
46092024-08-16T07:20:21.499ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:52838 req_id = ce90897d-5fe1-45d1-a822-5611779ee12b roles = RoleSet { roles: {} } uri = /metrics/producers
46102024-08-16T07:20:21.500ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:52838 req_id = ce90897d-5fe1-45d1-a822-5611779ee12b resource = Database result = Ok(()) uri = /metrics/producers
46112024-08-16T07:20:21.507ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1830 local_addr = [fd00:1122:3344:101::c]:53719 method = GET remote_addr = [fd00:1122:3344:101::d]:60737 req_id = 1314059d-f8b7-4d7f-a6d7-cfbcef1d8a9e response_code = 200 uri = /0d900881-9285-4dbf-910f-5e4676c8f133
46122024-08-16T07:20:21.532ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 62147b68-6c5f-49df-a144-ebe1b87f0e27
46132024-08-16T07:20:21.532ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:52838 req_id = ce90897d-5fe1-45d1-a822-5611779ee12b roles = RoleSet { roles: {} } uri = /metrics/producers
46142024-08-16T07:20:21.533ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:52838 req_id = ce90897d-5fe1-45d1-a822-5611779ee12b resource = Database result = Ok(()) uri = /metrics/producers
46152024-08-16T07:20:21.570ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 62147b68-6c5f-49df-a144-ebe1b87f0e27 uri = http://[fd00:1122:3344:101::d]:12223/producers
46162024-08-16T07:20:21.571ZDEBGnexus: client response oximeter-collector = 62147b68-6c5f-49df-a144-ebe1b87f0e27 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "8257971a-37f5-4b4f-92ee-df08b6e4b1e7", "date": "Fri, 16 Aug 2024 07:20:21 GMT"} })
46172024-08-16T07:20:21.571ZINFOnexus: assigned collector to new producer collector_id = 62147b68-6c5f-49df-a144-ebe1b87f0e27 file = nexus/src/app/oximeter.rs:125 producer_id = 0d900881-9285-4dbf-910f-5e4676c8f133
46182024-08-16T07:20:21.572ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 72453 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:52838 req_id = ce90897d-5fe1-45d1-a822-5611779ee12b response_code = 201 uri = /metrics/producers
46192024-08-16T07:20:21.572ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::c)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, status: 201, headers: {"content-type": "application/json", "x-request-id": "ce90897d-5fe1-45d1-a822-5611779ee12b", "content-length": "41", "date": "Fri, 16 Aug 2024 07:20:21 GMT"} })
46202024-08-16T07:20:21.573ZDEBGnexus (producer-registration-task): registered with nexus successfully
46212024-08-16T07:20:21.573ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
46222024-08-16T07:20:21.865ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64556 req_id = 768988e5-b6f5-4f77-a3bd-83d68380b355 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
46232024-08-16T07:20:21.865ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64556 req_id = 768988e5-b6f5-4f77-a3bd-83d68380b355 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
46242024-08-16T07:20:21.867ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2588 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64556 req_id = 768988e5-b6f5-4f77-a3bd-83d68380b355 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
46252024-08-16T07:20:22.033ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 2dcd3c5d-266f-4a4b-9d13-35db9bf595ef roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
46262024-08-16T07:20:22.033ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 2dcd3c5d-266f-4a4b-9d13-35db9bf595ef resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
46272024-08-16T07:20:22.035ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2008 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 2dcd3c5d-266f-4a4b-9d13-35db9bf595ef response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
46282024-08-16T07:20:23.054ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = b2ce90f4-0610-4124-99a6-ff23f76ae6b8 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
46292024-08-16T07:20:23.055ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = b2ce90f4-0610-4124-99a6-ff23f76ae6b8 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
46302024-08-16T07:20:23.056ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2173 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = b2ce90f4-0610-4124-99a6-ff23f76ae6b8 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
46312024-08-16T07:20:24.075ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 31698555-40b2-4582-87c3-08cbbc399ffa roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
46322024-08-16T07:20:24.076ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 31698555-40b2-4582-87c3-08cbbc399ffa resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
46332024-08-16T07:20:24.077ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2162 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 31698555-40b2-4582-87c3-08cbbc399ffa response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
46342024-08-16T07:20:25.096ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = de798aba-8821-4c9a-aaed-eb188459f1e0 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
46352024-08-16T07:20:25.096ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = de798aba-8821-4c9a-aaed-eb188459f1e0 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
46362024-08-16T07:20:25.098ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1985 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = de798aba-8821-4c9a-aaed-eb188459f1e0 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
46372024-08-16T07:20:26.118ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 1d5c59c4-def9-4735-9cc2-acbd07154bdf roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
46382024-08-16T07:20:26.118ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 1d5c59c4-def9-4735-9cc2-acbd07154bdf resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
46392024-08-16T07:20:26.120ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2119 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 1d5c59c4-def9-4735-9cc2-acbd07154bdf response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
46402024-08-16T07:20:27.139ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 3228198a-942a-49c2-95e2-f7f07e03b3d6 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
46412024-08-16T07:20:27.139ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 3228198a-942a-49c2-95e2-f7f07e03b3d6 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
46422024-08-16T07:20:27.141ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1915 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 3228198a-942a-49c2-95e2-f7f07e03b3d6 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
46432024-08-16T07:20:28.160ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 712cc209-2c31-4ec2-9503-c1d866460068 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
46442024-08-16T07:20:28.161ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 712cc209-2c31-4ec2-9503-c1d866460068 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
46452024-08-16T07:20:28.162ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2219 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 712cc209-2c31-4ec2-9503-c1d866460068 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
46462024-08-16T07:20:29.182ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = d049c70e-ccac-4560-a91a-0812550fbfbb roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
46472024-08-16T07:20:29.182ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = d049c70e-ccac-4560-a91a-0812550fbfbb resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
46482024-08-16T07:20:29.183ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1831 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = d049c70e-ccac-4560-a91a-0812550fbfbb response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
46492024-08-16T07:20:30.202ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = a41dc467-8862-44eb-bc57-340d338d5a35 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
46502024-08-16T07:20:30.203ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = a41dc467-8862-44eb-bc57-340d338d5a35 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
46512024-08-16T07:20:30.204ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1930 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = a41dc467-8862-44eb-bc57-340d338d5a35 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
46522024-08-16T07:20:30.856ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 23 reason = Timeout
46532024-08-16T07:20:30.856ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46542024-08-16T07:20:30.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46552024-08-16T07:20:30.858ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46562024-08-16T07:20:30.860ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
46572024-08-16T07:20:30.860ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46582024-08-16T07:20:30.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46592024-08-16T07:20:30.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46602024-08-16T07:20:30.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46612024-08-16T07:20:30.862ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46622024-08-16T07:20:30.862ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 23 reason = Timeout
46632024-08-16T07:20:30.862ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
46642024-08-16T07:20:30.862ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46652024-08-16T07:20:30.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46662024-08-16T07:20:30.864ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46672024-08-16T07:20:30.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46682024-08-16T07:20:30.864ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
46692024-08-16T07:20:30.864ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46702024-08-16T07:20:30.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46712024-08-16T07:20:30.865ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
46722024-08-16T07:20:30.865ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 2.719903ms iteration = 23 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
46732024-08-16T07:20:30.870ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
46742024-08-16T07:20:30.870ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 13.888711ms iteration = 23 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
46752024-08-16T07:20:31.224ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = ae7be0f8-015b-427a-8fb9-00a363cb3ddc roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
46762024-08-16T07:20:31.224ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = ae7be0f8-015b-427a-8fb9-00a363cb3ddc resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
46772024-08-16T07:20:31.226ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1887 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = ae7be0f8-015b-427a-8fb9-00a363cb3ddc response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
46782024-08-16T07:20:31.572ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 627 local_addr = [fd00:1122:3344:101::c]:53719 method = GET remote_addr = [fd00:1122:3344:101::d]:60737 req_id = bac95d8e-9dcb-46e0-bbe2-8463fa3bf307 response_code = 200 uri = /0d900881-9285-4dbf-910f-5e4676c8f133
46792024-08-16T07:20:32.245ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 327d9e20-0b68-46e5-97bf-fde6de607dd6 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
46802024-08-16T07:20:32.245ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 327d9e20-0b68-46e5-97bf-fde6de607dd6 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
46812024-08-16T07:20:32.247ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2236 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 327d9e20-0b68-46e5-97bf-fde6de607dd6 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
46822024-08-16T07:20:33.269ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 85418867-b232-472b-aae2-27d8bf8fdbe4 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
46832024-08-16T07:20:33.269ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 85418867-b232-472b-aae2-27d8bf8fdbe4 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
46842024-08-16T07:20:33.271ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2484 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 85418867-b232-472b-aae2-27d8bf8fdbe4 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
46852024-08-16T07:20:34.291ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = a8f93a34-d650-4bf1-8854-714d7a21bdf2 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
46862024-08-16T07:20:34.292ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = a8f93a34-d650-4bf1-8854-714d7a21bdf2 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
46872024-08-16T07:20:34.293ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2373 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = a8f93a34-d650-4bf1-8854-714d7a21bdf2 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
46882024-08-16T07:20:35.311ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 8c6f4ef3-3d39-4fad-b69f-7b743947b458 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
46892024-08-16T07:20:35.311ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 8c6f4ef3-3d39-4fad-b69f-7b743947b458 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
46902024-08-16T07:20:35.313ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2362 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 8c6f4ef3-3d39-4fad-b69f-7b743947b458 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
46912024-08-16T07:20:36.333ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 9d8a2646-1e17-4049-ad9b-2fc9255b770f roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
46922024-08-16T07:20:36.333ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 9d8a2646-1e17-4049-ad9b-2fc9255b770f resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
46932024-08-16T07:20:36.335ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1758 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 9d8a2646-1e17-4049-ad9b-2fc9255b770f response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
46942024-08-16T07:20:37.355ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 7eaa3e50-2290-427c-aedc-90b09a61cb56 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
46952024-08-16T07:20:37.355ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 7eaa3e50-2290-427c-aedc-90b09a61cb56 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
46962024-08-16T07:20:37.357ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1974 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 7eaa3e50-2290-427c-aedc-90b09a61cb56 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
46972024-08-16T07:20:38.376ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 63d0723e-28d3-4415-be7f-a4e98bcaa3d8 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
46982024-08-16T07:20:38.376ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 63d0723e-28d3-4415-be7f-a4e98bcaa3d8 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
46992024-08-16T07:20:38.378ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1895 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 63d0723e-28d3-4415-be7f-a4e98bcaa3d8 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
47002024-08-16T07:20:39.397ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = b4916263-30cc-4ac3-ae99-2bbea8ed66d3 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
47012024-08-16T07:20:39.397ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = b4916263-30cc-4ac3-ae99-2bbea8ed66d3 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
47022024-08-16T07:20:39.399ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1739 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = b4916263-30cc-4ac3-ae99-2bbea8ed66d3 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
47032024-08-16T07:20:40.419ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = da904e12-0e50-4f5b-b5a1-f9230bbc87af roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
47042024-08-16T07:20:40.419ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = da904e12-0e50-4f5b-b5a1-f9230bbc87af resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
47052024-08-16T07:20:40.421ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2432 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = da904e12-0e50-4f5b-b5a1-f9230bbc87af response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
47062024-08-16T07:20:40.856ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 24 reason = Timeout
47072024-08-16T07:20:40.856ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47082024-08-16T07:20:40.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47092024-08-16T07:20:40.858ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47102024-08-16T07:20:40.860ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
47112024-08-16T07:20:40.860ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47122024-08-16T07:20:40.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47132024-08-16T07:20:40.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47142024-08-16T07:20:40.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47152024-08-16T07:20:40.862ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 24 reason = Timeout
47162024-08-16T07:20:40.862ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
47172024-08-16T07:20:40.862ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47182024-08-16T07:20:40.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47192024-08-16T07:20:40.862ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47202024-08-16T07:20:40.863ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47212024-08-16T07:20:40.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47222024-08-16T07:20:40.865ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
47232024-08-16T07:20:40.865ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 2.687982ms iteration = 24 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
47242024-08-16T07:20:40.865ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
47252024-08-16T07:20:40.865ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47262024-08-16T07:20:40.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47272024-08-16T07:20:40.871ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
47282024-08-16T07:20:40.871ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 14.955985ms iteration = 24 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
47292024-08-16T07:20:41.441ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = c17d71f8-2f03-497c-8084-61e3960ca9e3 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
47302024-08-16T07:20:41.441ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = c17d71f8-2f03-497c-8084-61e3960ca9e3 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
47312024-08-16T07:20:41.443ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1793 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = c17d71f8-2f03-497c-8084-61e3960ca9e3 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
47322024-08-16T07:20:41.572ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 671 local_addr = [fd00:1122:3344:101::c]:53719 method = GET remote_addr = [fd00:1122:3344:101::d]:60737 req_id = 4b4bc7d4-9ff7-43b0-b834-09353a5778b4 response_code = 200 uri = /0d900881-9285-4dbf-910f-5e4676c8f133
47332024-08-16T07:20:42.462ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 48cc7758-ee27-4601-94a0-0cac2ae37642 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
47342024-08-16T07:20:42.463ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 48cc7758-ee27-4601-94a0-0cac2ae37642 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
47352024-08-16T07:20:42.464ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1926 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 48cc7758-ee27-4601-94a0-0cac2ae37642 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
47362024-08-16T07:20:43.484ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = c4c0c6e0-71d6-43a7-8213-30c438fb9734 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
47372024-08-16T07:20:43.484ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = c4c0c6e0-71d6-43a7-8213-30c438fb9734 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
47382024-08-16T07:20:43.486ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2923 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = c4c0c6e0-71d6-43a7-8213-30c438fb9734 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
47392024-08-16T07:20:44.504ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 00111887-6d50-4d20-beff-863c6f919be6 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
47402024-08-16T07:20:44.505ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 00111887-6d50-4d20-beff-863c6f919be6 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
47412024-08-16T07:20:44.506ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2033 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 00111887-6d50-4d20-beff-863c6f919be6 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
47422024-08-16T07:20:45.525ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 639ecb6c-09c8-48eb-8731-69dec2dc6225 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
47432024-08-16T07:20:45.525ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 639ecb6c-09c8-48eb-8731-69dec2dc6225 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
47442024-08-16T07:20:45.527ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2416 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 639ecb6c-09c8-48eb-8731-69dec2dc6225 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
47452024-08-16T07:20:46.547ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = d857348b-488f-482c-bb2b-ff6c0e0691f4 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
47462024-08-16T07:20:46.547ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = d857348b-488f-482c-bb2b-ff6c0e0691f4 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
47472024-08-16T07:20:46.549ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2289 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = d857348b-488f-482c-bb2b-ff6c0e0691f4 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
47482024-08-16T07:20:47.568ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = f425fa7e-9db6-4a0d-93d2-6407ae71408a roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
47492024-08-16T07:20:47.568ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = f425fa7e-9db6-4a0d-93d2-6407ae71408a resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
47502024-08-16T07:20:47.570ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1959 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = f425fa7e-9db6-4a0d-93d2-6407ae71408a response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
47512024-08-16T07:20:48.590ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 5c86504b-5491-4779-a9be-dbdf9593dc80 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
47522024-08-16T07:20:48.590ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 5c86504b-5491-4779-a9be-dbdf9593dc80 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
47532024-08-16T07:20:48.591ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1877 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 5c86504b-5491-4779-a9be-dbdf9593dc80 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
47542024-08-16T07:20:49.611ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = fbcfc5d8-3886-4a22-818b-3437de5b8c1e roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
47552024-08-16T07:20:49.611ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = fbcfc5d8-3886-4a22-818b-3437de5b8c1e resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
47562024-08-16T07:20:49.613ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1948 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = fbcfc5d8-3886-4a22-818b-3437de5b8c1e response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
47572024-08-16T07:20:50.632ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = a10044c0-e65c-452f-a9e8-19af8cab3161 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
47582024-08-16T07:20:50.632ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = a10044c0-e65c-452f-a9e8-19af8cab3161 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
47592024-08-16T07:20:50.634ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2445 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = a10044c0-e65c-452f-a9e8-19af8cab3161 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
47602024-08-16T07:20:50.856ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 6 reason = Timeout
47612024-08-16T07:20:50.856ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 5 reason = Timeout
47622024-08-16T07:20:50.856ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:69 reason = blueprint disabled target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d
47632024-08-16T07:20:50.856ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 9 reason = Timeout
47642024-08-16T07:20:50.856ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
47652024-08-16T07:20:50.856ZWARNnexus (BackgroundTasks): phantom disk task started background_task = phantom_disks file = nexus/src/app/background/tasks/phantom_disks.rs:46
47662024-08-16T07:20:50.856ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 31.951\u{b5}s iteration = 6 status = {"error":"blueprint disabled","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d"}
47672024-08-16T07:20:50.856ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
47682024-08-16T07:20:50.856ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 9 reason = Timeout
47692024-08-16T07:20:50.856ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 5 reason = Timeout
47702024-08-16T07:20:50.856ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 5 reason = Timeout
47712024-08-16T07:20:50.856ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
47722024-08-16T07:20:50.856ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
47732024-08-16T07:20:50.856ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 25 reason = Timeout
47742024-08-16T07:20:50.856ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 5 reason = Timeout
47752024-08-16T07:20:50.856ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47762024-08-16T07:20:50.856ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 9 reason = Timeout
47772024-08-16T07:20:50.856ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
47782024-08-16T07:20:50.856ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 5 reason = Timeout
47792024-08-16T07:20:50.856ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
47802024-08-16T07:20:50.856ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
47812024-08-16T07:20:50.856ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 5 reason = Timeout
47822024-08-16T07:20:50.856ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-08-16 07:10:50.856536050 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
47832024-08-16T07:20:50.856ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 7 reason = Timeout
47842024-08-16T07:20:50.856ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
47852024-08-16T07:20:50.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
47862024-08-16T07:20:50.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
47872024-08-16T07:20:50.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
47882024-08-16T07:20:50.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
47892024-08-16T07:20:50.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
47902024-08-16T07:20:50.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47912024-08-16T07:20:50.857ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 5 reason = Timeout
47922024-08-16T07:20:50.857ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 11 reason = Timeout
47932024-08-16T07:20:50.857ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
47942024-08-16T07:20:50.857ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
47952024-08-16T07:20:50.857ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
47962024-08-16T07:20:50.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
47972024-08-16T07:20:50.857ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("dec19c15-1a2d-47ac-9b9e-9f424d3a3464.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f9649eef-936b-4765-9810-da8662275db5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f9649eef-936b-4765-9810-da8662275db5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1314, tv_nsec: 233415423 } })
47982024-08-16T07:20:50.857ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6d6264ea-5d56-4938-8c26-581ed0b9907b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a8440aa3-608b-4c08-b70c-6d92a9461396.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("aea2243f-052e-4953-bdfa-7c3368895dd2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("aea2243f-052e-4953-bdfa-7c3368895dd2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1314, tv_nsec: 233476564 } })
47992024-08-16T07:20:50.857ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
48002024-08-16T07:20:50.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
48012024-08-16T07:20:50.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
48022024-08-16T07:20:50.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
48032024-08-16T07:20:50.858ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
48042024-08-16T07:20:50.858ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.808272ms iteration = 5 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
48052024-08-16T07:20:50.858ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48062024-08-16T07:20:50.858ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48072024-08-16T07:20:50.858ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
48082024-08-16T07:20:50.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
48092024-08-16T07:20:50.859ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
48102024-08-16T07:20:50.859ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 2.743973ms iteration = 5 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
48112024-08-16T07:20:50.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48122024-08-16T07:20:50.859ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-08-16 07:10:50.856536050 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
48132024-08-16T07:20:50.859ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.437679ms iteration = 5 status = {"expiration":"2024-08-16T07:10:50.856536050Z","pruned":[]}
48142024-08-16T07:20:50.860ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1314, tv_nsec: 236282639 } })
48152024-08-16T07:20:50.860ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48162024-08-16T07:20:50.860ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48172024-08-16T07:20:50.860ZWARNnexus (BackgroundTasks): phantom disk task done background_task = phantom_disks file = nexus/src/app/background/tasks/phantom_disks.rs:93
48182024-08-16T07:20:50.860ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.374861ms iteration = 9 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
48192024-08-16T07:20:50.861ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
48202024-08-16T07:20:50.861ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
48212024-08-16T07:20:50.861ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
48222024-08-16T07:20:50.861ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
48232024-08-16T07:20:50.861ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
48242024-08-16T07:20:50.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
48252024-08-16T07:20:50.861ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1314, tv_nsec: 237745693 } })
48262024-08-16T07:20:50.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
48272024-08-16T07:20:50.861ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
48282024-08-16T07:20:50.862ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 9 reason = Timeout
48292024-08-16T07:20:50.862ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 25 reason = Timeout
48302024-08-16T07:20:50.862ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
48312024-08-16T07:20:50.862ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48322024-08-16T07:20:50.862ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48332024-08-16T07:20:50.862ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 9 reason = Timeout
48342024-08-16T07:20:50.862ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48352024-08-16T07:20:50.862ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 9 reason = Timeout
48362024-08-16T07:20:50.862ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 9 reason = Timeout
48372024-08-16T07:20:50.862ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
48382024-08-16T07:20:50.862ZINFOnexus (BackgroundTasks): region snapshot replacement start task started background_task = region_snapshot_replacement_start file = nexus/src/app/background/tasks/region_snapshot_replacement_start.rs:236
48392024-08-16T07:20:50.862ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
48402024-08-16T07:20:50.862ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 9 reason = Timeout
48412024-08-16T07:20:50.862ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
48422024-08-16T07:20:50.862ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
48432024-08-16T07:20:50.862ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 9 reason = Timeout
48442024-08-16T07:20:50.862ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48452024-08-16T07:20:50.862ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 9 reason = Timeout
48462024-08-16T07:20:50.862ZINFOnexus (BackgroundTasks): region snapshot replacement garbage collect task started background_task = region_snapshot_replacement_garbage_collection file = nexus/src/app/background/tasks/region_snapshot_replacement_garbage_collect.rs:133
48472024-08-16T07:20:50.862ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
48482024-08-16T07:20:50.862ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 5 reason = Timeout
48492024-08-16T07:20:50.862ZINFOnexus (BackgroundTasks): lookup region port task started background_task = lookup_region_port file = nexus/src/app/background/tasks/lookup_region_port.rs:56
48502024-08-16T07:20:50.862ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
48512024-08-16T07:20:50.862ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 7 reason = Timeout
48522024-08-16T07:20:50.862ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 5 reason = Timeout
48532024-08-16T07:20:50.862ZINFOnexus (BackgroundTasks): Abandoned VMM reaper running background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:76
48542024-08-16T07:20:50.862ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
48552024-08-16T07:20:50.862ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 9 reason = Timeout
48562024-08-16T07:20:50.862ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48572024-08-16T07:20:50.862ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 9 reason = Timeout
48582024-08-16T07:20:50.862ZWARNnexus (BackgroundTasks): region replacement task started background_task = region_replacement file = nexus/src/app/background/tasks/region_replacement.rs:64
48592024-08-16T07:20:50.862ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
48602024-08-16T07:20:50.862ZWARNnexus (BackgroundTasks): physical disk adoption task started background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:100
48612024-08-16T07:20:50.862ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
48622024-08-16T07:20:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
48632024-08-16T07:20:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48642024-08-16T07:20:50.862ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48652024-08-16T07:20:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48662024-08-16T07:20:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
48672024-08-16T07:20:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
48682024-08-16T07:20:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
48692024-08-16T07:20:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
48702024-08-16T07:20:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48712024-08-16T07:20:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
48722024-08-16T07:20:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48732024-08-16T07:20:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
48742024-08-16T07:20:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
48752024-08-16T07:20:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
48762024-08-16T07:20:50.863ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
48772024-08-16T07:20:50.863ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
48782024-08-16T07:20:50.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
48792024-08-16T07:20:50.864ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
48802024-08-16T07:20:50.864ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48812024-08-16T07:20:50.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48822024-08-16T07:20:50.864ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48832024-08-16T07:20:50.864ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48842024-08-16T07:20:50.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48852024-08-16T07:20:50.865ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
48862024-08-16T07:20:50.866ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
48872024-08-16T07:20:50.866ZINFOnexus (BackgroundTasks): lookup region port task done background_task = lookup_region_port file = nexus/src/app/background/tasks/lookup_region_port.rs:150
48882024-08-16T07:20:50.866ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 4.455963ms iteration = 5 status = {"errors":[],"found_port_ok":[]}
48892024-08-16T07:20:50.866ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
48902024-08-16T07:20:50.866ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48912024-08-16T07:20:50.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48922024-08-16T07:20:50.868ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
48932024-08-16T07:20:50.868ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
48942024-08-16T07:20:50.868ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 5.980638ms iteration = 5 status = {"error":null,"error_count":0,"found":0,"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0}
48952024-08-16T07:20:50.874ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48962024-08-16T07:20:50.875ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
48972024-08-16T07:20:50.875ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 12.98807ms iteration = 25 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
48982024-08-16T07:20:50.875ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
48992024-08-16T07:20:50.875ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
49002024-08-16T07:20:50.875ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
49012024-08-16T07:20:50.875ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49022024-08-16T07:20:50.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
49032024-08-16T07:20:50.876ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
49042024-08-16T07:20:50.876ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49052024-08-16T07:20:50.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49062024-08-16T07:20:50.877ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
49072024-08-16T07:20:50.877ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
49082024-08-16T07:20:50.877ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
49092024-08-16T07:20:50.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
49102024-08-16T07:20:50.877ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
49112024-08-16T07:20:50.877ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
49122024-08-16T07:20:50.877ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 15.461807ms iteration = 9 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
49132024-08-16T07:20:50.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
49142024-08-16T07:20:50.877ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49152024-08-16T07:20:50.877ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
49162024-08-16T07:20:50.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
49172024-08-16T07:20:50.878ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49182024-08-16T07:20:50.879ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49192024-08-16T07:20:50.879ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
49202024-08-16T07:20:50.879ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49212024-08-16T07:20:50.879ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
49222024-08-16T07:20:50.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49232024-08-16T07:20:50.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49242024-08-16T07:20:50.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
49252024-08-16T07:20:50.880ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49262024-08-16T07:20:50.881ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
49272024-08-16T07:20:50.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49282024-08-16T07:20:50.881ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
49292024-08-16T07:20:50.881ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
49302024-08-16T07:20:50.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
49312024-08-16T07:20:50.882ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
49322024-08-16T07:20:50.882ZWARNnexus (BackgroundTasks): region replacement task done background_task = region_replacement file = nexus/src/app/background/tasks/region_replacement.rs:185
49332024-08-16T07:20:50.882ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
49342024-08-16T07:20:50.882ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 20.396111ms iteration = 9 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
49352024-08-16T07:20:50.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
49362024-08-16T07:20:50.883ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
49372024-08-16T07:20:50.883ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 21.479517ms iteration = 9 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
49382024-08-16T07:20:50.884ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
49392024-08-16T07:20:50.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
49402024-08-16T07:20:50.884ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49412024-08-16T07:20:50.885ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49422024-08-16T07:20:50.886ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
49432024-08-16T07:20:50.886ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
49442024-08-16T07:20:50.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49452024-08-16T07:20:50.887ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
49462024-08-16T07:20:50.887ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
49472024-08-16T07:20:50.887ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49482024-08-16T07:20:50.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
49492024-08-16T07:20:50.888ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
49502024-08-16T07:20:50.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49512024-08-16T07:20:50.889ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
49522024-08-16T07:20:50.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49532024-08-16T07:20:50.889ZWARNnexus (BackgroundTasks): physical disk adoption task done background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:174
49542024-08-16T07:20:50.889ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 32.843808ms iteration = 11 status = {"physical_disks_added":0}
49552024-08-16T07:20:50.890ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
49562024-08-16T07:20:50.890ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49572024-08-16T07:20:50.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49582024-08-16T07:20:50.890ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49592024-08-16T07:20:50.892ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
49602024-08-16T07:20:50.892ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
49612024-08-16T07:20:50.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49622024-08-16T07:20:50.893ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49632024-08-16T07:20:50.894ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
49642024-08-16T07:20:50.894ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
49652024-08-16T07:20:50.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49662024-08-16T07:20:50.902ZINFOnexus (BackgroundTasks): region snapshot replacement garbage collect task done background_task = region_snapshot_replacement_garbage_collection file = nexus/src/app/background/tasks/region_snapshot_replacement_garbage_collect.rs:147
49672024-08-16T07:20:50.902ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 40.23421ms iteration = 9 status = {"errors":[],"garbage_collect_requested":[]}
49682024-08-16T07:20:50.902ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
49692024-08-16T07:20:50.902ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
49702024-08-16T07:20:50.902ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
49712024-08-16T07:20:50.902ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
49722024-08-16T07:20:50.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
49732024-08-16T07:20:50.903ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49742024-08-16T07:20:50.903ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
49752024-08-16T07:20:50.903ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
49762024-08-16T07:20:50.903ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
49772024-08-16T07:20:50.903ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
49782024-08-16T07:20:50.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
49792024-08-16T07:20:50.904ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
49802024-08-16T07:20:50.904ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
49812024-08-16T07:20:50.904ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 47.387935ms iteration = 5 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
49822024-08-16T07:20:50.904ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49832024-08-16T07:20:50.906ZINFOnexus (BackgroundTasks): region snapshot replacement start task done background_task = region_snapshot_replacement_start file = nexus/src/app/background/tasks/region_snapshot_replacement_start.rs:252
49842024-08-16T07:20:50.906ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 43.918344ms iteration = 9 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
49852024-08-16T07:20:50.906ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
49862024-08-16T07:20:50.906ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
49872024-08-16T07:20:50.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
49882024-08-16T07:20:50.907ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
49892024-08-16T07:20:50.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49902024-08-16T07:20:50.907ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
49912024-08-16T07:20:50.907ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
49922024-08-16T07:20:50.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
49932024-08-16T07:20:50.908ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
49942024-08-16T07:20:50.908ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = ddebb22e-3faa-4936-9b3e-0f4d28827c0e dns_zone_name = oxide.test found_so_far = 0 version = 2
49952024-08-16T07:20:50.908ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
49962024-08-16T07:20:50.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
49972024-08-16T07:20:50.909ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
49982024-08-16T07:20:50.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49992024-08-16T07:20:50.909ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50002024-08-16T07:20:50.909ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
50012024-08-16T07:20:50.909ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 2c55b660-f328-498e-b44c-73da75015ed4 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
50022024-08-16T07:20:50.909ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
50032024-08-16T07:20:50.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
50042024-08-16T07:20:50.909ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50052024-08-16T07:20:50.911ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
50062024-08-16T07:20:50.911ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
50072024-08-16T07:20:50.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
50082024-08-16T07:20:50.912ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae, lookup_type: ById(03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae) } result = Ok(())
50092024-08-16T07:20:50.912ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50102024-08-16T07:20:50.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50112024-08-16T07:20:50.913ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50122024-08-16T07:20:50.914ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 52.639706ms iteration = 9 status = 0
50132024-08-16T07:20:50.915ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = ddebb22e-3faa-4936-9b3e-0f4d28827c0e dns_zone_name = oxide.test found_so_far = 1 version = 2
50142024-08-16T07:20:50.915ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
50152024-08-16T07:20:50.915ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-08-16 07:16:55.724690 UTC dns_group = external generation = 2
50162024-08-16T07:20:50.915ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 58.894261ms iteration = 5 status = {"generation":2}
50172024-08-16T07:20:50.916ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
50182024-08-16T07:20:50.916ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
50192024-08-16T07:20:50.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
50202024-08-16T07:20:50.920ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 2c55b660-f328-498e-b44c-73da75015ed4 dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
50212024-08-16T07:20:50.920ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
50222024-08-16T07:20:50.920ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-08-16 07:16:55.302318 UTC dns_group = internal generation = 1
50232024-08-16T07:20:50.920ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 63.902335ms iteration = 5 status = {"generation":1}
50242024-08-16T07:20:50.927ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-08-16T07:16:49.943339Z, time_modified: 2024-08-16T07:16:49.943339Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, db_silo: Silo { identity: SiloIdentity { id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-16T07:16:55.682566Z, time_modified: 2024-08-16T07:16:55.682566Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "c9e400628d2b58a74b998fbfa44a053952e83a6e8d3c49e6518981bf7d4a006f" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, db_silo: Silo { identity: SiloIdentity { id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-16T07:16:55.682566Z, time_modified: 2024-08-16T07:16:55.682566Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "c9e400628d2b58a74b998fbfa44a053952e83a6e8d3c49e6518981bf7d4a006f" }] }) }
50252024-08-16T07:20:50.927ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 70.773815ms iteration = 5 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071","tls_certs":["c9e400628d2b58a74b998fbfa44a053952e83a6e8d3c49e6518981bf7d4a006f"]}},"default_endpoint":{"silo_id":"439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071","tls_certs":["c9e400628d2b58a74b998fbfa44a053952e83a6e8d3c49e6518981bf7d4a006f"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
50262024-08-16T07:20:51.008ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
50272024-08-16T07:20:51.008ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
50282024-08-16T07:20:51.009ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "32deb29c-eda5-4cc1-8bee-d6bec5faf219", "content-length": "26", "date": "Fri, 16 Aug 2024 07:20:51 GMT"} })
50292024-08-16T07:20:51.009ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
50302024-08-16T07:20:51.010ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
50312024-08-16T07:20:51.015ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
50322024-08-16T07:20:51.015ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
50332024-08-16T07:20:51.015ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "fc6c6241-0ba8-4cb3-ba6f-545ebeed9433", "content-length": "26", "date": "Fri, 16 Aug 2024 07:20:51 GMT"} })
50342024-08-16T07:20:51.015ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
50352024-08-16T07:20:51.017ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
50362024-08-16T07:20:51.065ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
50372024-08-16T07:20:51.065ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "7eea62f9-eb7b-4283-94f2-550375ca3c5f", "content-length": "691", "date": "Fri, 16 Aug 2024 07:20:51 GMT"} })
50382024-08-16T07:20:51.065ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
50392024-08-16T07:20:51.065ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
50402024-08-16T07:20:51.065ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
50412024-08-16T07:20:51.066ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 204.351759ms iteration = 9 status = {}
50422024-08-16T07:20:51.071ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
50432024-08-16T07:20:51.071ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 215.127778ms iteration = 25 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
50442024-08-16T07:20:51.170ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
50452024-08-16T07:20:51.170ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "fd74afa0-a78b-46ea-8bfe-db4305c8f096", "content-length": "1", "date": "Fri, 16 Aug 2024 07:20:50 GMT"} })
50462024-08-16T07:20:51.171ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
50472024-08-16T07:20:51.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
50482024-08-16T07:20:51.173ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 316.864308ms iteration = 9 status = null
50492024-08-16T07:20:51.239ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
50502024-08-16T07:20:51.291ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
50512024-08-16T07:20:51.338ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
50522024-08-16T07:20:51.338ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "81155d4a-897c-4408-b4b2-3802447e6d06", "content-length": "372", "date": "Fri, 16 Aug 2024 07:20:51 GMT"} })
50532024-08-16T07:20:51.338ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50542024-08-16T07:20:51.339ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50552024-08-16T07:20:51.340ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1314, tv_nsec: 716395007 } })
50562024-08-16T07:20:51.341ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50572024-08-16T07:20:51.341ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
50582024-08-16T07:20:51.341ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50592024-08-16T07:20:51.343ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50602024-08-16T07:20:51.343ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50612024-08-16T07:20:51.345ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
50622024-08-16T07:20:51.346ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "cdb845f8-c15c-4902-b11f-06c7da31f41b", "date": "Fri, 16 Aug 2024 07:20:51 GMT"} })
50632024-08-16T07:20:51.347ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 485.229666ms iteration = 9 status = {}
50642024-08-16T07:20:51.442ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 586.248048ms iteration = 9 status = {}
50652024-08-16T07:20:51.462ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a zone_address = fd00:1122:3344:101::2
50662024-08-16T07:20:51.462ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
50672024-08-16T07:20:51.462ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e5bed558-e37f-4106-b76f-95060a3de7cb", "content-length": "26", "date": "Fri, 16 Aug 2024 07:20:51 GMT"} })
50682024-08-16T07:20:51.462ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
50692024-08-16T07:20:51.464ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
50702024-08-16T07:20:51.533ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
50712024-08-16T07:20:51.550ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
50722024-08-16T07:20:51.550ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "dc251aad-04c5-4947-bb35-3dd3914ea07a", "date": "Fri, 16 Aug 2024 07:20:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
50732024-08-16T07:20:51.550ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
50742024-08-16T07:20:51.553ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "efac34b4-435a-4f03-9e1d-367297e7bd85", "date": "Fri, 16 Aug 2024 07:20:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
50752024-08-16T07:20:51.553ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
50762024-08-16T07:20:51.554ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
50772024-08-16T07:20:51.554ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 692.279797ms iteration = 7 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
50782024-08-16T07:20:51.572ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 651 local_addr = [fd00:1122:3344:101::c]:53719 method = GET remote_addr = [fd00:1122:3344:101::d]:60737 req_id = 9db4492d-5c97-4361-8dde-53ea0a6d34ea response_code = 200 uri = /0d900881-9285-4dbf-910f-5e4676c8f133
50792024-08-16T07:20:51.606ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
50802024-08-16T07:20:51.606ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "f7c6eaca-bad8-4241-b1f9-d3ec12fce82a", "date": "Fri, 16 Aug 2024 07:20:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
50812024-08-16T07:20:51.606ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
50822024-08-16T07:20:51.609ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "8e3ef68a-95fc-41d7-bf09-59acfa1d4ed5", "date": "Fri, 16 Aug 2024 07:20:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
50832024-08-16T07:20:51.609ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
50842024-08-16T07:20:51.611ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "d0d8c05c-dcca-450e-b2a3-c670e304dde4", "date": "Fri, 16 Aug 2024 07:20:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
50852024-08-16T07:20:51.611ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
50862024-08-16T07:20:51.613ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
50872024-08-16T07:20:51.613ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 756.955261ms iteration = 7 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
50882024-08-16T07:20:51.641ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50892024-08-16T07:20:51.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50902024-08-16T07:20:51.643ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:146 port = SwitchPort { id: f13c0939-2c9d-4a0d-b006-5f3de89cc4fc, rack_id: e1b0d583-7b20-4a4b-97f9-9f83300aeb7a, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(4de7fcf8-2b1f-4b0e-ba6f-584e8a34addb) } rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0
50912024-08-16T07:20:51.643ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50922024-08-16T07:20:51.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50932024-08-16T07:20:51.651ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
50942024-08-16T07:20:51.651ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "8ed27c9d-3a3d-424b-9df5-af8c9595220a", "content-length": "121", "date": "Fri, 16 Aug 2024 07:20:50 GMT"} })
50952024-08-16T07:20:51.651ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1663 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
50962024-08-16T07:20:51.651ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1690 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 4de7fcf8-2b1f-4b0e-ba6f-584e8a34addb
50972024-08-16T07:20:51.651ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None)}}
50982024-08-16T07:20:51.651ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None)}}
50992024-08-16T07:20:51.651ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {}
51002024-08-16T07:20:51.651ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {}
51012024-08-16T07:20:51.651ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
51022024-08-16T07:20:51.651ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51032024-08-16T07:20:51.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51042024-08-16T07:20:51.653ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
51052024-08-16T07:20:51.653ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "9de3d31f-bf89-458a-870d-60eefdc8bf98", "content-length": "2", "date": "Fri, 16 Aug 2024 07:20:50 GMT"} })
51062024-08-16T07:20:51.653ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
51072024-08-16T07:20:51.653ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f06ca252-6bbd-4e33-b065-7b79a6ca999c", "content-length": "52", "date": "Fri, 16 Aug 2024 07:20:50 GMT"} })
51082024-08-16T07:20:51.653ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0
51092024-08-16T07:20:51.653ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
51102024-08-16T07:20:51.654ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = f1c92435-8a50-475c-81b2-73941be1fabb roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
51112024-08-16T07:20:51.654ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = f1c92435-8a50-475c-81b2-73941be1fabb resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
51122024-08-16T07:20:51.656ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2538 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = f1c92435-8a50-475c-81b2-73941be1fabb response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
51132024-08-16T07:20:51.707ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "8aa8b2c1-9cfd-4882-9673-d9d473a78204", "date": "Fri, 16 Aug 2024 07:20:51 GMT"} })
51142024-08-16T07:20:51.707ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch = Switch0
51152024-08-16T07:20:51.707ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
51162024-08-16T07:20:51.707ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "9624a266-f703-4ca5-b9b3-b5b3f8660f8c", "content-length": "494", "date": "Fri, 16 Aug 2024 07:20:51 GMT"} })
51172024-08-16T07:20:51.707ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51182024-08-16T07:20:51.707ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51192024-08-16T07:20:51.710ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51202024-08-16T07:20:51.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51212024-08-16T07:20:51.714ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51222024-08-16T07:20:51.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51232024-08-16T07:20:51.715ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51242024-08-16T07:20:51.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51252024-08-16T07:20:51.724ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 862.088679ms iteration = 9 status = {}
51262024-08-16T07:20:51.900ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64556 req_id = bc06f9be-eec6-45e1-84b2-e7a1d748585c roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
51272024-08-16T07:20:51.900ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64556 req_id = bc06f9be-eec6-45e1-84b2-e7a1d748585c resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
51282024-08-16T07:20:51.902ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2510 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64556 req_id = bc06f9be-eec6-45e1-84b2-e7a1d748585c response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
51292024-08-16T07:20:52.729ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 1fc19309-ced5-4c34-8080-09c0add79786 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
51302024-08-16T07:20:52.729ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 1fc19309-ced5-4c34-8080-09c0add79786 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
51312024-08-16T07:20:52.731ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1752 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 1fc19309-ced5-4c34-8080-09c0add79786 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
51322024-08-16T07:20:53.750ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 94314717-59e2-46d0-b271-847c7709d4eb roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
51332024-08-16T07:20:53.750ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 94314717-59e2-46d0-b271-847c7709d4eb resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
51342024-08-16T07:20:53.752ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2175 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 94314717-59e2-46d0-b271-847c7709d4eb response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
51352024-08-16T07:20:54.771ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 80249e38-5994-4359-96e4-473a5bec0278 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
51362024-08-16T07:20:54.771ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 80249e38-5994-4359-96e4-473a5bec0278 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
51372024-08-16T07:20:54.773ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1907 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 80249e38-5994-4359-96e4-473a5bec0278 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
51382024-08-16T07:20:55.792ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 42996817-ac0d-4382-9f2a-32c39a5e1bd0 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
51392024-08-16T07:20:55.792ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 42996817-ac0d-4382-9f2a-32c39a5e1bd0 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
51402024-08-16T07:20:55.794ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1833 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 42996817-ac0d-4382-9f2a-32c39a5e1bd0 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
51412024-08-16T07:20:56.814ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 6e0d45ba-d712-4e64-bcdb-72d27aae4570 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
51422024-08-16T07:20:56.814ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 6e0d45ba-d712-4e64-bcdb-72d27aae4570 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
51432024-08-16T07:20:56.816ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1811 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 6e0d45ba-d712-4e64-bcdb-72d27aae4570 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
51442024-08-16T07:20:57.835ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 6d445b18-b0ff-43b9-ae8e-2234867c33ce roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
51452024-08-16T07:20:57.835ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 6d445b18-b0ff-43b9-ae8e-2234867c33ce resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
51462024-08-16T07:20:57.836ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1849 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 6d445b18-b0ff-43b9-ae8e-2234867c33ce response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
51472024-08-16T07:20:58.857ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = d61d342d-4807-4bf5-9bf9-a23e07a9ef8e roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
51482024-08-16T07:20:58.857ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = d61d342d-4807-4bf5-9bf9-a23e07a9ef8e resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
51492024-08-16T07:20:58.859ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1989 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = d61d342d-4807-4bf5-9bf9-a23e07a9ef8e response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
51502024-08-16T07:20:59.880ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = bacb3b0c-125b-4aef-a6bf-6299406b5b70 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
51512024-08-16T07:20:59.880ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = bacb3b0c-125b-4aef-a6bf-6299406b5b70 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
51522024-08-16T07:20:59.882ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 3001 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = bacb3b0c-125b-4aef-a6bf-6299406b5b70 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
51532024-08-16T07:21:00.856ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 26 reason = Timeout
51542024-08-16T07:21:00.856ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51552024-08-16T07:21:00.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51562024-08-16T07:21:00.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51572024-08-16T07:21:00.859ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
51582024-08-16T07:21:00.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51592024-08-16T07:21:00.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51602024-08-16T07:21:00.860ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51612024-08-16T07:21:00.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51622024-08-16T07:21:00.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51632024-08-16T07:21:00.862ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 26 reason = Timeout
51642024-08-16T07:21:00.862ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
51652024-08-16T07:21:00.862ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
51662024-08-16T07:21:00.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
51672024-08-16T07:21:00.864ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
51682024-08-16T07:21:00.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
51692024-08-16T07:21:00.864ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
51702024-08-16T07:21:00.864ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51712024-08-16T07:21:00.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51722024-08-16T07:21:00.865ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
51732024-08-16T07:21:00.865ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 2.60342ms iteration = 26 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
51742024-08-16T07:21:00.875ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
51752024-08-16T07:21:00.875ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.154672ms iteration = 26 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
51762024-08-16T07:21:00.902ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = f64b3068-d4f9-4cdc-8b18-c159b3b96c8d roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
51772024-08-16T07:21:00.902ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = f64b3068-d4f9-4cdc-8b18-c159b3b96c8d resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
51782024-08-16T07:21:00.904ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2093 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = f64b3068-d4f9-4cdc-8b18-c159b3b96c8d response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
51792024-08-16T07:21:01.572ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 561 local_addr = [fd00:1122:3344:101::c]:53719 method = GET remote_addr = [fd00:1122:3344:101::d]:60737 req_id = 5622e471-bbfa-41b6-bbe2-25c54d1f2594 response_code = 200 uri = /0d900881-9285-4dbf-910f-5e4676c8f133
51802024-08-16T07:21:01.925ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = e6f2b7f2-84c2-4e2d-851f-4cff2d2fd101 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
51812024-08-16T07:21:01.925ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = e6f2b7f2-84c2-4e2d-851f-4cff2d2fd101 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
51822024-08-16T07:21:01.927ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2152 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = e6f2b7f2-84c2-4e2d-851f-4cff2d2fd101 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
51832024-08-16T07:21:02.947ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = efc170dc-1dff-4f90-9670-7f027953b63a roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
51842024-08-16T07:21:02.947ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = efc170dc-1dff-4f90-9670-7f027953b63a resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
51852024-08-16T07:21:02.949ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2267 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = efc170dc-1dff-4f90-9670-7f027953b63a response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
51862024-08-16T07:21:03.968ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 3cfdf8e9-1790-4235-9b4c-2a3882b7bdb3 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
51872024-08-16T07:21:03.968ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 3cfdf8e9-1790-4235-9b4c-2a3882b7bdb3 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
51882024-08-16T07:21:03.969ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1749 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 3cfdf8e9-1790-4235-9b4c-2a3882b7bdb3 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
51892024-08-16T07:21:04.990ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = ac76b7b6-7034-45f9-97f0-3f0d4010b5a8 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
51902024-08-16T07:21:04.990ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = ac76b7b6-7034-45f9-97f0-3f0d4010b5a8 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
51912024-08-16T07:21:04.991ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1572 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = ac76b7b6-7034-45f9-97f0-3f0d4010b5a8 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
51922024-08-16T07:21:06.010ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 08b5e90a-2104-4c83-a0ab-d60f367e799a roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
51932024-08-16T07:21:06.010ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 08b5e90a-2104-4c83-a0ab-d60f367e799a resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
51942024-08-16T07:21:06.012ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1982 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 08b5e90a-2104-4c83-a0ab-d60f367e799a response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
51952024-08-16T07:21:07.032ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 9317b1f9-8062-4e40-b349-f349770afd61 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
51962024-08-16T07:21:07.032ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 9317b1f9-8062-4e40-b349-f349770afd61 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
51972024-08-16T07:21:07.034ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2364 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 9317b1f9-8062-4e40-b349-f349770afd61 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
51982024-08-16T07:21:08.054ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 658afc04-7571-42e6-84df-c9d7990114f5 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
51992024-08-16T07:21:08.054ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 658afc04-7571-42e6-84df-c9d7990114f5 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
52002024-08-16T07:21:08.056ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1924 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 658afc04-7571-42e6-84df-c9d7990114f5 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
52012024-08-16T07:21:09.075ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 20198b87-ba92-4d9f-a924-0dcb50b4071b roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
52022024-08-16T07:21:09.075ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 20198b87-ba92-4d9f-a924-0dcb50b4071b resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
52032024-08-16T07:21:09.077ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2566 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 20198b87-ba92-4d9f-a924-0dcb50b4071b response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
52042024-08-16T07:21:10.097ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = afc17d6b-b043-43d4-b180-07495024130e roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
52052024-08-16T07:21:10.097ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = afc17d6b-b043-43d4-b180-07495024130e resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
52062024-08-16T07:21:10.099ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2563 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = afc17d6b-b043-43d4-b180-07495024130e response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
52072024-08-16T07:21:10.856ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 27 reason = Timeout
52082024-08-16T07:21:10.856ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52092024-08-16T07:21:10.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52102024-08-16T07:21:10.858ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52112024-08-16T07:21:10.861ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
52122024-08-16T07:21:10.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52132024-08-16T07:21:10.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52142024-08-16T07:21:10.862ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 27 reason = Timeout
52152024-08-16T07:21:10.862ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
52162024-08-16T07:21:10.862ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52172024-08-16T07:21:10.862ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52182024-08-16T07:21:10.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52192024-08-16T07:21:10.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52202024-08-16T07:21:10.863ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52212024-08-16T07:21:10.864ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52222024-08-16T07:21:10.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52232024-08-16T07:21:10.865ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
52242024-08-16T07:21:10.865ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.251956ms iteration = 27 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
52252024-08-16T07:21:10.865ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
52262024-08-16T07:21:10.865ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52272024-08-16T07:21:10.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52282024-08-16T07:21:10.871ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
52292024-08-16T07:21:10.871ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 14.472754ms iteration = 27 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
52302024-08-16T07:21:11.121ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 5fd6c6cb-d2eb-4a41-affe-de5cd6b778a0 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
52312024-08-16T07:21:11.121ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 5fd6c6cb-d2eb-4a41-affe-de5cd6b778a0 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
52322024-08-16T07:21:11.123ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2152 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 5fd6c6cb-d2eb-4a41-affe-de5cd6b778a0 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
52332024-08-16T07:21:11.572ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 677 local_addr = [fd00:1122:3344:101::c]:53719 method = GET remote_addr = [fd00:1122:3344:101::d]:60737 req_id = 47a8a4a6-f82a-482b-86b9-3be7a80c28bf response_code = 200 uri = /0d900881-9285-4dbf-910f-5e4676c8f133
52342024-08-16T07:21:12.143ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = be4a9c0f-2618-4ae1-8c36-aa6de04986d3 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
52352024-08-16T07:21:12.143ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = be4a9c0f-2618-4ae1-8c36-aa6de04986d3 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
52362024-08-16T07:21:12.145ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2518 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = be4a9c0f-2618-4ae1-8c36-aa6de04986d3 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
52372024-08-16T07:21:13.164ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 657ca39b-fff2-4c73-91a9-3f5684b9cb73 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
52382024-08-16T07:21:13.165ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 657ca39b-fff2-4c73-91a9-3f5684b9cb73 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
52392024-08-16T07:21:13.166ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2116 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 657ca39b-fff2-4c73-91a9-3f5684b9cb73 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
52402024-08-16T07:21:14.185ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 25fce996-cec8-4069-86f5-f2335f8f4e1c roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
52412024-08-16T07:21:14.186ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 25fce996-cec8-4069-86f5-f2335f8f4e1c resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
52422024-08-16T07:21:14.187ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1996 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 25fce996-cec8-4069-86f5-f2335f8f4e1c response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
52432024-08-16T07:21:15.206ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = d8b84fa2-463d-4b9e-bff7-3b19d9dc4e75 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
52442024-08-16T07:21:15.206ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = d8b84fa2-463d-4b9e-bff7-3b19d9dc4e75 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
52452024-08-16T07:21:15.208ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1788 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = d8b84fa2-463d-4b9e-bff7-3b19d9dc4e75 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
52462024-08-16T07:21:16.228ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 5d544e2c-0cea-449c-90a5-bfa8b305f629 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
52472024-08-16T07:21:16.228ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 5d544e2c-0cea-449c-90a5-bfa8b305f629 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
52482024-08-16T07:21:16.230ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1745 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 5d544e2c-0cea-449c-90a5-bfa8b305f629 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
52492024-08-16T07:21:17.250ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 11d6fd40-abb8-42c2-b639-4c3c1825b557 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
52502024-08-16T07:21:17.250ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 11d6fd40-abb8-42c2-b639-4c3c1825b557 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
52512024-08-16T07:21:17.252ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2195 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 11d6fd40-abb8-42c2-b639-4c3c1825b557 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
52522024-08-16T07:21:18.271ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 5d3ed023-80a3-4452-8eab-8c38d2a9cb3d roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
52532024-08-16T07:21:18.271ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 5d3ed023-80a3-4452-8eab-8c38d2a9cb3d resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
52542024-08-16T07:21:18.273ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1754 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 5d3ed023-80a3-4452-8eab-8c38d2a9cb3d response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
52552024-08-16T07:21:19.292ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = f76c7067-2c68-4b29-90be-a3f18da04fe7 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
52562024-08-16T07:21:19.292ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = f76c7067-2c68-4b29-90be-a3f18da04fe7 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
52572024-08-16T07:21:19.294ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1930 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = f76c7067-2c68-4b29-90be-a3f18da04fe7 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
52582024-08-16T07:21:20.314ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = c628af8a-add8-4662-91a1-3d432763f730 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
52592024-08-16T07:21:20.315ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = c628af8a-add8-4662-91a1-3d432763f730 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
52602024-08-16T07:21:20.316ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1709 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = c628af8a-add8-4662-91a1-3d432763f730 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
52612024-08-16T07:21:20.856ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 10 reason = Timeout
52622024-08-16T07:21:20.856ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 10 reason = Timeout
52632024-08-16T07:21:20.856ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
52642024-08-16T07:21:20.856ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
52652024-08-16T07:21:20.856ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 10 reason = Timeout
52662024-08-16T07:21:20.856ZWARNnexus (BackgroundTasks): phantom disk task started background_task = phantom_disks file = nexus/src/app/background/tasks/phantom_disks.rs:46
52672024-08-16T07:21:20.856ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 28 reason = Timeout
52682024-08-16T07:21:20.856ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52692024-08-16T07:21:20.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
52702024-08-16T07:21:20.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
52712024-08-16T07:21:20.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52722024-08-16T07:21:20.857ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 12 reason = Timeout
52732024-08-16T07:21:20.857ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
52742024-08-16T07:21:20.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
52752024-08-16T07:21:20.858ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52762024-08-16T07:21:20.858ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52772024-08-16T07:21:20.859ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1344, tv_nsec: 235652486 } })
52782024-08-16T07:21:20.859ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
52792024-08-16T07:21:20.859ZWARNnexus (BackgroundTasks): phantom disk task done background_task = phantom_disks file = nexus/src/app/background/tasks/phantom_disks.rs:93
52802024-08-16T07:21:20.859ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.44683ms iteration = 10 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
52812024-08-16T07:21:20.860ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1344, tv_nsec: 236716641 } })
52822024-08-16T07:21:20.860ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
52832024-08-16T07:21:20.861ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
52842024-08-16T07:21:20.861ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
52852024-08-16T07:21:20.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
52862024-08-16T07:21:20.861ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
52872024-08-16T07:21:20.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52882024-08-16T07:21:20.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52892024-08-16T07:21:20.862ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 10 reason = Timeout
52902024-08-16T07:21:20.862ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 28 reason = Timeout
52912024-08-16T07:21:20.862ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
52922024-08-16T07:21:20.862ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52932024-08-16T07:21:20.862ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
52942024-08-16T07:21:20.862ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 10 reason = Timeout
52952024-08-16T07:21:20.862ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 10 reason = Timeout
52962024-08-16T07:21:20.862ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52972024-08-16T07:21:20.862ZINFOnexus (BackgroundTasks): region snapshot replacement start task started background_task = region_snapshot_replacement_start file = nexus/src/app/background/tasks/region_snapshot_replacement_start.rs:236
52982024-08-16T07:21:20.862ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
52992024-08-16T07:21:20.862ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 10 reason = Timeout
53002024-08-16T07:21:20.862ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 10 reason = Timeout
53012024-08-16T07:21:20.862ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
53022024-08-16T07:21:20.862ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
53032024-08-16T07:21:20.862ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53042024-08-16T07:21:20.862ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 10 reason = Timeout
53052024-08-16T07:21:20.862ZINFOnexus (BackgroundTasks): region snapshot replacement garbage collect task started background_task = region_snapshot_replacement_garbage_collection file = nexus/src/app/background/tasks/region_snapshot_replacement_garbage_collect.rs:133
53062024-08-16T07:21:20.862ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
53072024-08-16T07:21:20.862ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 10 reason = Timeout
53082024-08-16T07:21:20.862ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53092024-08-16T07:21:20.862ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 10 reason = Timeout
53102024-08-16T07:21:20.862ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
53112024-08-16T07:21:20.862ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 10 reason = Timeout
53122024-08-16T07:21:20.862ZWARNnexus (BackgroundTasks): region replacement task started background_task = region_replacement file = nexus/src/app/background/tasks/region_replacement.rs:64
53132024-08-16T07:21:20.862ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
53142024-08-16T07:21:20.862ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53152024-08-16T07:21:20.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53162024-08-16T07:21:20.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
53172024-08-16T07:21:20.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
53182024-08-16T07:21:20.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
53192024-08-16T07:21:20.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53202024-08-16T07:21:20.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53212024-08-16T07:21:20.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53222024-08-16T07:21:20.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
53232024-08-16T07:21:20.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53242024-08-16T07:21:20.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
53252024-08-16T07:21:20.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
53262024-08-16T07:21:20.863ZWARNnexus (BackgroundTasks): physical disk adoption task started background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:100
53272024-08-16T07:21:20.863ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
53282024-08-16T07:21:20.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
53292024-08-16T07:21:20.863ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53302024-08-16T07:21:20.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53312024-08-16T07:21:20.864ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53322024-08-16T07:21:20.864ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53332024-08-16T07:21:20.864ZINFOnexus (BackgroundTasks): region snapshot replacement garbage collect task done background_task = region_snapshot_replacement_garbage_collection file = nexus/src/app/background/tasks/region_snapshot_replacement_garbage_collect.rs:147
53342024-08-16T07:21:20.864ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 2.001876ms iteration = 10 status = {"errors":[],"garbage_collect_requested":[]}
53352024-08-16T07:21:20.864ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53362024-08-16T07:21:20.865ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53372024-08-16T07:21:20.865ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
53382024-08-16T07:21:20.865ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 2.630981ms iteration = 28 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
53392024-08-16T07:21:20.865ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53402024-08-16T07:21:20.866ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
53412024-08-16T07:21:20.866ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
53422024-08-16T07:21:20.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
53432024-08-16T07:21:20.867ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
53442024-08-16T07:21:20.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
53452024-08-16T07:21:20.867ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
53462024-08-16T07:21:20.867ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
53472024-08-16T07:21:20.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
53482024-08-16T07:21:20.867ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
53492024-08-16T07:21:20.867ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53502024-08-16T07:21:20.867ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53512024-08-16T07:21:20.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53522024-08-16T07:21:20.868ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
53532024-08-16T07:21:20.868ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53542024-08-16T07:21:20.868ZINFOnexus (BackgroundTasks): region snapshot replacement start task done background_task = region_snapshot_replacement_start file = nexus/src/app/background/tasks/region_snapshot_replacement_start.rs:252
53552024-08-16T07:21:20.868ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 5.723293ms iteration = 10 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
53562024-08-16T07:21:20.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53572024-08-16T07:21:20.868ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
53582024-08-16T07:21:20.868ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53592024-08-16T07:21:20.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
53602024-08-16T07:21:20.869ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
53612024-08-16T07:21:20.869ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
53622024-08-16T07:21:20.869ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
53632024-08-16T07:21:20.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
53642024-08-16T07:21:20.869ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
53652024-08-16T07:21:20.869ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53662024-08-16T07:21:20.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53672024-08-16T07:21:20.870ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53682024-08-16T07:21:20.870ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
53692024-08-16T07:21:20.870ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53702024-08-16T07:21:20.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53712024-08-16T07:21:20.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53722024-08-16T07:21:20.870ZWARNnexus (BackgroundTasks): region replacement task done background_task = region_replacement file = nexus/src/app/background/tasks/region_replacement.rs:185
53732024-08-16T07:21:20.870ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 7.910433ms iteration = 10 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
53742024-08-16T07:21:20.870ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
53752024-08-16T07:21:20.870ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53762024-08-16T07:21:20.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53772024-08-16T07:21:20.871ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1344, tv_nsec: 248323129 } })
53782024-08-16T07:21:20.871ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
53792024-08-16T07:21:20.871ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
53802024-08-16T07:21:20.871ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 9.154051ms iteration = 10 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
53812024-08-16T07:21:20.872ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
53822024-08-16T07:21:20.872ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
53832024-08-16T07:21:20.872ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 9.714484ms iteration = 10 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
53842024-08-16T07:21:20.874ZWARNnexus (BackgroundTasks): physical disk adoption task done background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:174
53852024-08-16T07:21:20.874ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 16.557583ms iteration = 12 status = {"physical_disks_added":0}
53862024-08-16T07:21:20.876ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
53872024-08-16T07:21:20.876ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.857108ms iteration = 28 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
53882024-08-16T07:21:20.876ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
53892024-08-16T07:21:20.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
53902024-08-16T07:21:20.881ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53912024-08-16T07:21:20.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53922024-08-16T07:21:20.883ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
53932024-08-16T07:21:20.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
53942024-08-16T07:21:20.883ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53952024-08-16T07:21:20.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53962024-08-16T07:21:20.884ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53972024-08-16T07:21:20.884ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53982024-08-16T07:21:20.886ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
53992024-08-16T07:21:20.886ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
54002024-08-16T07:21:20.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
54012024-08-16T07:21:20.887ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae, lookup_type: ById(03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae) } result = Ok(())
54022024-08-16T07:21:20.887ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54032024-08-16T07:21:20.887ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54042024-08-16T07:21:20.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54052024-08-16T07:21:20.888ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 26.064262ms iteration = 10 status = 0
54062024-08-16T07:21:20.889ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
54072024-08-16T07:21:20.889ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
54082024-08-16T07:21:20.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
54092024-08-16T07:21:21.008ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
54102024-08-16T07:21:21.009ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "1a3eb518-5908-4731-a74b-4b5567febd27", "content-length": "372", "date": "Fri, 16 Aug 2024 07:21:21 GMT"} })
54112024-08-16T07:21:21.009ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54122024-08-16T07:21:21.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54132024-08-16T07:21:21.011ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54142024-08-16T07:21:21.012ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a zone_address = fd00:1122:3344:101::2
54152024-08-16T07:21:21.012ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
54162024-08-16T07:21:21.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54172024-08-16T07:21:21.012ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "3e77638c-8991-4683-a133-4cd26e083a29", "content-length": "26", "date": "Fri, 16 Aug 2024 07:21:21 GMT"} })
54182024-08-16T07:21:21.012ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
54192024-08-16T07:21:21.013ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
54202024-08-16T07:21:21.014ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54212024-08-16T07:21:21.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54222024-08-16T07:21:21.017ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
54232024-08-16T07:21:21.017ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "184365bd-a9bc-4103-8fb9-ddd7fae1f6de", "date": "Fri, 16 Aug 2024 07:21:21 GMT"} })
54242024-08-16T07:21:21.018ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 155.485731ms iteration = 10 status = {}
54252024-08-16T07:21:21.161ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
54262024-08-16T07:21:21.161ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
54272024-08-16T07:21:21.161ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ed3cb55a-01de-4765-9f54-3e8143825379", "content-length": "26", "date": "Fri, 16 Aug 2024 07:21:21 GMT"} })
54282024-08-16T07:21:21.161ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
54292024-08-16T07:21:21.162ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
54302024-08-16T07:21:21.184ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
54312024-08-16T07:21:21.184ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
54322024-08-16T07:21:21.185ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a29c3267-ca8a-44a8-b2a3-b45380bf0bac", "content-length": "26", "date": "Fri, 16 Aug 2024 07:21:21 GMT"} })
54332024-08-16T07:21:21.185ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
54342024-08-16T07:21:21.186ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
54352024-08-16T07:21:21.196ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
54362024-08-16T07:21:21.196ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "937b4170-d98e-4229-b864-31608c5573f6", "content-length": "691", "date": "Fri, 16 Aug 2024 07:21:21 GMT"} })
54372024-08-16T07:21:21.196ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
54382024-08-16T07:21:21.197ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
54392024-08-16T07:21:21.197ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
54402024-08-16T07:21:21.198ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 336.090102ms iteration = 10 status = {}
54412024-08-16T07:21:21.247ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 390.666542ms iteration = 10 status = {}
54422024-08-16T07:21:21.259ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
54432024-08-16T07:21:21.259ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "fd038f4e-aee5-4a4f-b27a-67844fb37247", "content-length": "1", "date": "Fri, 16 Aug 2024 07:21:20 GMT"} })
54442024-08-16T07:21:21.261ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
54452024-08-16T07:21:21.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
54462024-08-16T07:21:21.263ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 406.713773ms iteration = 10 status = null
54472024-08-16T07:21:21.275ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54482024-08-16T07:21:21.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54492024-08-16T07:21:21.277ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:146 port = SwitchPort { id: f13c0939-2c9d-4a0d-b006-5f3de89cc4fc, rack_id: e1b0d583-7b20-4a4b-97f9-9f83300aeb7a, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(4de7fcf8-2b1f-4b0e-ba6f-584e8a34addb) } rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0
54502024-08-16T07:21:21.277ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54512024-08-16T07:21:21.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54522024-08-16T07:21:21.287ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
54532024-08-16T07:21:21.288ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "9df9ad8b-4716-4bb4-9117-d8a0a048cb5c", "content-length": "121", "date": "Fri, 16 Aug 2024 07:21:20 GMT"} })
54542024-08-16T07:21:21.288ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1663 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
54552024-08-16T07:21:21.288ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1690 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 4de7fcf8-2b1f-4b0e-ba6f-584e8a34addb
54562024-08-16T07:21:21.288ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None)}}
54572024-08-16T07:21:21.288ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None)}}
54582024-08-16T07:21:21.288ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {}
54592024-08-16T07:21:21.288ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {}
54602024-08-16T07:21:21.288ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
54612024-08-16T07:21:21.288ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54622024-08-16T07:21:21.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54632024-08-16T07:21:21.290ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
54642024-08-16T07:21:21.290ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "563772db-859b-4252-be62-b738fe610225", "content-length": "2", "date": "Fri, 16 Aug 2024 07:21:20 GMT"} })
54652024-08-16T07:21:21.290ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
54662024-08-16T07:21:21.290ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "2c377c61-c095-436e-8d95-cf47041df731", "content-length": "52", "date": "Fri, 16 Aug 2024 07:21:20 GMT"} })
54672024-08-16T07:21:21.290ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0
54682024-08-16T07:21:21.290ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
54692024-08-16T07:21:21.343ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "d3b5b542-d3d4-46e2-890b-2c2978a9d404", "date": "Fri, 16 Aug 2024 07:21:21 GMT"} })
54702024-08-16T07:21:21.343ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch = Switch0
54712024-08-16T07:21:21.343ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
54722024-08-16T07:21:21.343ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "369203f2-c316-47c4-8f04-e20b25426857", "content-length": "494", "date": "Fri, 16 Aug 2024 07:21:21 GMT"} })
54732024-08-16T07:21:21.343ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54742024-08-16T07:21:21.343ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54752024-08-16T07:21:21.343ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 465e1c35-5915-4a33-bc54-e47f00ed2b70 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
54762024-08-16T07:21:21.344ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 465e1c35-5915-4a33-bc54-e47f00ed2b70 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
54772024-08-16T07:21:21.345ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1543 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 465e1c35-5915-4a33-bc54-e47f00ed2b70 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
54782024-08-16T07:21:21.345ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54792024-08-16T07:21:21.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54802024-08-16T07:21:21.348ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54812024-08-16T07:21:21.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54822024-08-16T07:21:21.349ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54832024-08-16T07:21:21.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54842024-08-16T07:21:21.356ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 493.409655ms iteration = 10 status = {}
54852024-08-16T07:21:21.571ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 618 local_addr = [fd00:1122:3344:101::c]:53719 method = GET remote_addr = [fd00:1122:3344:101::d]:60737 req_id = 61163bd6-f266-456d-854f-4fe1abc8b49b response_code = 200 uri = /0d900881-9285-4dbf-910f-5e4676c8f133
54862024-08-16T07:21:21.932ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64556 req_id = 4e303f40-0054-47e0-b4b9-a08a4b11612b roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
54872024-08-16T07:21:21.932ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64556 req_id = 4e303f40-0054-47e0-b4b9-a08a4b11612b resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
54882024-08-16T07:21:21.934ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2442 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64556 req_id = 4e303f40-0054-47e0-b4b9-a08a4b11612b response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
54892024-08-16T07:21:22.363ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 175c42ec-0f22-494a-83ec-f7bc9d4a10be roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
54902024-08-16T07:21:22.364ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 175c42ec-0f22-494a-83ec-f7bc9d4a10be resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
54912024-08-16T07:21:22.366ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2553 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 175c42ec-0f22-494a-83ec-f7bc9d4a10be response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
54922024-08-16T07:21:23.389ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = c4aff4a3-9d6b-47f3-9179-daff00f4652a roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
54932024-08-16T07:21:23.389ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = c4aff4a3-9d6b-47f3-9179-daff00f4652a resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
54942024-08-16T07:21:23.391ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 3114 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = c4aff4a3-9d6b-47f3-9179-daff00f4652a response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
54952024-08-16T07:21:24.410ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 51244ba8-3072-456f-a580-38673d5070c4 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
54962024-08-16T07:21:24.411ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 51244ba8-3072-456f-a580-38673d5070c4 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
54972024-08-16T07:21:24.413ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2169 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 51244ba8-3072-456f-a580-38673d5070c4 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
54982024-08-16T07:21:25.432ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 69810c94-1699-415c-be8e-8f25ae062fb6 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
54992024-08-16T07:21:25.433ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 69810c94-1699-415c-be8e-8f25ae062fb6 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
55002024-08-16T07:21:25.434ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1950 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 69810c94-1699-415c-be8e-8f25ae062fb6 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
55012024-08-16T07:21:26.455ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = df0e78d0-c4ec-4af4-9217-ba6dd2c79261 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
55022024-08-16T07:21:26.456ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = df0e78d0-c4ec-4af4-9217-ba6dd2c79261 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
55032024-08-16T07:21:26.457ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2659 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = df0e78d0-c4ec-4af4-9217-ba6dd2c79261 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
55042024-08-16T07:21:27.476ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = b1984c92-eba1-4795-8a1f-6b79967e8be7 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
55052024-08-16T07:21:27.477ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = b1984c92-eba1-4795-8a1f-6b79967e8be7 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
55062024-08-16T07:21:27.478ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2446 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = b1984c92-eba1-4795-8a1f-6b79967e8be7 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
55072024-08-16T07:21:28.499ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 3d5c0b5c-170c-47fb-b5d9-fa39f90c6287 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
55082024-08-16T07:21:28.500ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 3d5c0b5c-170c-47fb-b5d9-fa39f90c6287 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
55092024-08-16T07:21:28.501ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1696 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 3d5c0b5c-170c-47fb-b5d9-fa39f90c6287 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
55102024-08-16T07:21:29.520ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 7ee7ccd4-e936-4f95-b0d9-4834843a13a8 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
55112024-08-16T07:21:29.521ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 7ee7ccd4-e936-4f95-b0d9-4834843a13a8 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
55122024-08-16T07:21:29.522ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1987 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 7ee7ccd4-e936-4f95-b0d9-4834843a13a8 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
55132024-08-16T07:21:30.543ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 56399507-7ae3-4536-9db3-01172bb20f12 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
55142024-08-16T07:21:30.543ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 56399507-7ae3-4536-9db3-01172bb20f12 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
55152024-08-16T07:21:30.545ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2118 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 56399507-7ae3-4536-9db3-01172bb20f12 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
55162024-08-16T07:21:30.856ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 29 reason = Timeout
55172024-08-16T07:21:30.856ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55182024-08-16T07:21:30.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55192024-08-16T07:21:30.858ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55202024-08-16T07:21:30.860ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
55212024-08-16T07:21:30.860ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55222024-08-16T07:21:30.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55232024-08-16T07:21:30.862ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55242024-08-16T07:21:30.862ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 29 reason = Timeout
55252024-08-16T07:21:30.862ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
55262024-08-16T07:21:30.862ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
55272024-08-16T07:21:30.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55282024-08-16T07:21:30.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
55292024-08-16T07:21:30.863ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55302024-08-16T07:21:30.863ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
55312024-08-16T07:21:30.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
55322024-08-16T07:21:30.864ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
55332024-08-16T07:21:30.864ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 2.771974ms iteration = 29 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
55342024-08-16T07:21:30.865ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
55352024-08-16T07:21:30.865ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55362024-08-16T07:21:30.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55372024-08-16T07:21:30.871ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
55382024-08-16T07:21:30.871ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 14.679559ms iteration = 29 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
55392024-08-16T07:21:31.565ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 4b597859-cf86-4a37-acac-d5b3b672ea3b roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
55402024-08-16T07:21:31.566ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 4b597859-cf86-4a37-acac-d5b3b672ea3b resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
55412024-08-16T07:21:31.567ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2114 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 4b597859-cf86-4a37-acac-d5b3b672ea3b response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
55422024-08-16T07:21:31.571ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 603 local_addr = [fd00:1122:3344:101::c]:53719 method = GET remote_addr = [fd00:1122:3344:101::d]:60737 req_id = 8f85224d-1aaf-4f7e-ac39-3f9fa7faff16 response_code = 200 uri = /0d900881-9285-4dbf-910f-5e4676c8f133
55432024-08-16T07:21:32.588ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 75316629-7b0a-457a-9a9b-115b67c6dde6 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
55442024-08-16T07:21:32.589ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 75316629-7b0a-457a-9a9b-115b67c6dde6 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
55452024-08-16T07:21:32.590ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1737 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 75316629-7b0a-457a-9a9b-115b67c6dde6 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
55462024-08-16T07:21:33.610ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 1cf42b3f-96c3-4308-9aec-783859ad4b05 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
55472024-08-16T07:21:33.611ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 1cf42b3f-96c3-4308-9aec-783859ad4b05 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
55482024-08-16T07:21:33.612ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1860 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 1cf42b3f-96c3-4308-9aec-783859ad4b05 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
55492024-08-16T07:21:34.632ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 8a880710-9361-45cd-a4d4-92110c661d6f roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
55502024-08-16T07:21:34.633ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 8a880710-9361-45cd-a4d4-92110c661d6f resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
55512024-08-16T07:21:34.634ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1908 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 8a880710-9361-45cd-a4d4-92110c661d6f response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
55522024-08-16T07:21:35.653ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = c0a1aa5e-42fd-4653-80cb-d385296ffc95 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
55532024-08-16T07:21:35.654ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = c0a1aa5e-42fd-4653-80cb-d385296ffc95 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
55542024-08-16T07:21:35.655ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1731 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = c0a1aa5e-42fd-4653-80cb-d385296ffc95 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
55552024-08-16T07:21:36.674ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 164a8050-afd4-459c-b6d1-57b7cc522c2d roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
55562024-08-16T07:21:36.674ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 164a8050-afd4-459c-b6d1-57b7cc522c2d resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
55572024-08-16T07:21:36.676ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2279 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 164a8050-afd4-459c-b6d1-57b7cc522c2d response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
55582024-08-16T07:21:37.696ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = fd19acdb-200e-47e6-b61c-b20894c89da1 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
55592024-08-16T07:21:37.697ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = fd19acdb-200e-47e6-b61c-b20894c89da1 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
55602024-08-16T07:21:37.698ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2335 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = fd19acdb-200e-47e6-b61c-b20894c89da1 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
55612024-08-16T07:21:38.717ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 82eb0c75-dee4-4242-9c74-61f5fdebb3eb roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
55622024-08-16T07:21:38.717ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 82eb0c75-dee4-4242-9c74-61f5fdebb3eb resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
55632024-08-16T07:21:38.719ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1739 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 82eb0c75-dee4-4242-9c74-61f5fdebb3eb response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
55642024-08-16T07:21:39.739ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 3d091af2-d50f-44e2-ac9b-8a8d5ef52d05 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
55652024-08-16T07:21:39.740ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 3d091af2-d50f-44e2-ac9b-8a8d5ef52d05 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
55662024-08-16T07:21:39.741ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1826 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 3d091af2-d50f-44e2-ac9b-8a8d5ef52d05 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
55672024-08-16T07:21:40.761ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = e82c7244-729d-4ded-9539-3b00d006ad19 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
55682024-08-16T07:21:40.761ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = e82c7244-729d-4ded-9539-3b00d006ad19 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
55692024-08-16T07:21:40.762ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1716 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = e82c7244-729d-4ded-9539-3b00d006ad19 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
55702024-08-16T07:21:40.855ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 30 reason = Timeout
55712024-08-16T07:21:40.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55722024-08-16T07:21:40.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55732024-08-16T07:21:40.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55742024-08-16T07:21:40.859ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
55752024-08-16T07:21:40.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55762024-08-16T07:21:40.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55772024-08-16T07:21:40.860ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55782024-08-16T07:21:40.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55792024-08-16T07:21:40.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55802024-08-16T07:21:40.861ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 30 reason = Timeout
55812024-08-16T07:21:40.861ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
55822024-08-16T07:21:40.861ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
55832024-08-16T07:21:40.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
55842024-08-16T07:21:40.862ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
55852024-08-16T07:21:40.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
55862024-08-16T07:21:40.863ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
55872024-08-16T07:21:40.863ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55882024-08-16T07:21:40.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55892024-08-16T07:21:40.864ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
55902024-08-16T07:21:40.864ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 2.768584ms iteration = 30 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
55912024-08-16T07:21:40.869ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
55922024-08-16T07:21:40.869ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 13.612314ms iteration = 30 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
55932024-08-16T07:21:41.572ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 998 local_addr = [fd00:1122:3344:101::c]:53719 method = GET remote_addr = [fd00:1122:3344:101::d]:60737 req_id = b37bd01c-2173-4fbd-9ab6-5371c380aa6f response_code = 200 uri = /0d900881-9285-4dbf-910f-5e4676c8f133
55942024-08-16T07:21:41.785ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 1238d2c3-4718-4017-8cf7-e692a1684083 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
55952024-08-16T07:21:41.785ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 1238d2c3-4718-4017-8cf7-e692a1684083 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
55962024-08-16T07:21:41.787ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2142 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 1238d2c3-4718-4017-8cf7-e692a1684083 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
55972024-08-16T07:21:42.806ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = e7ca1276-78fe-451a-b816-ce5903437ee5 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
55982024-08-16T07:21:42.806ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = e7ca1276-78fe-451a-b816-ce5903437ee5 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
55992024-08-16T07:21:42.807ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2270 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = e7ca1276-78fe-451a-b816-ce5903437ee5 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
56002024-08-16T07:21:43.827ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 0580dbad-10fe-46d2-92d6-8a9625e24362 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
56012024-08-16T07:21:43.827ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 0580dbad-10fe-46d2-92d6-8a9625e24362 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
56022024-08-16T07:21:43.829ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1680 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 0580dbad-10fe-46d2-92d6-8a9625e24362 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
56032024-08-16T07:21:44.848ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 9c0aa68d-b82d-4530-ad25-c6cac2d94b10 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
56042024-08-16T07:21:44.849ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 9c0aa68d-b82d-4530-ad25-c6cac2d94b10 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
56052024-08-16T07:21:44.850ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2058 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 9c0aa68d-b82d-4530-ad25-c6cac2d94b10 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
56062024-08-16T07:21:45.870ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 48c20710-907c-4c35-99a4-2605c92a50f2 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
56072024-08-16T07:21:45.871ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 48c20710-907c-4c35-99a4-2605c92a50f2 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
56082024-08-16T07:21:45.873ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2509 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 48c20710-907c-4c35-99a4-2605c92a50f2 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
56092024-08-16T07:21:46.892ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = ae36dd6d-a400-483b-9e2e-3b458fa02069 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
56102024-08-16T07:21:46.892ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = ae36dd6d-a400-483b-9e2e-3b458fa02069 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
56112024-08-16T07:21:46.894ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2010 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = ae36dd6d-a400-483b-9e2e-3b458fa02069 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
56122024-08-16T07:21:47.913ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = a7493617-c1bd-4aab-b9f0-375fe0f41393 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
56132024-08-16T07:21:47.914ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = a7493617-c1bd-4aab-b9f0-375fe0f41393 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
56142024-08-16T07:21:47.915ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1653 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = a7493617-c1bd-4aab-b9f0-375fe0f41393 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
56152024-08-16T07:21:48.934ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 92d55b29-35d0-4966-8137-827f4d07c081 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
56162024-08-16T07:21:48.935ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 92d55b29-35d0-4966-8137-827f4d07c081 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
56172024-08-16T07:21:48.936ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1797 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 92d55b29-35d0-4966-8137-827f4d07c081 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
56182024-08-16T07:21:49.956ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 49537bd2-5d0c-44c4-a8ee-ad95ccd80f61 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
56192024-08-16T07:21:49.956ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 49537bd2-5d0c-44c4-a8ee-ad95ccd80f61 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
56202024-08-16T07:21:49.958ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2106 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 49537bd2-5d0c-44c4-a8ee-ad95ccd80f61 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
56212024-08-16T07:21:50.856ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 6 reason = Timeout
56222024-08-16T07:21:50.856ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
56232024-08-16T07:21:50.856ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 31 reason = Timeout
56242024-08-16T07:21:50.856ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
56252024-08-16T07:21:50.856ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 6 reason = Timeout
56262024-08-16T07:21:50.856ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-08-16 07:11:50.856143498 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
56272024-08-16T07:21:50.856ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56282024-08-16T07:21:50.856ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
56292024-08-16T07:21:50.856ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 6 reason = Timeout
56302024-08-16T07:21:50.856ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
56312024-08-16T07:21:50.856ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 6 reason = Timeout
56322024-08-16T07:21:50.856ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
56332024-08-16T07:21:50.856ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 8 reason = Timeout
56342024-08-16T07:21:50.856ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 11 reason = Timeout
56352024-08-16T07:21:50.856ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
56362024-08-16T07:21:50.856ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 6 reason = Timeout
56372024-08-16T07:21:50.856ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 7 reason = Timeout
56382024-08-16T07:21:50.856ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:69 reason = blueprint disabled target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d
56392024-08-16T07:21:50.856ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 15.81\u{b5}s iteration = 7 status = {"error":"blueprint disabled","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d"}
56402024-08-16T07:21:50.856ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 11 reason = Timeout
56412024-08-16T07:21:50.856ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 6 reason = Timeout
56422024-08-16T07:21:50.856ZWARNnexus (BackgroundTasks): phantom disk task started background_task = phantom_disks file = nexus/src/app/background/tasks/phantom_disks.rs:46
56432024-08-16T07:21:50.856ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
56442024-08-16T07:21:50.856ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 11 reason = Timeout
56452024-08-16T07:21:50.856ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
56462024-08-16T07:21:50.856ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 6 reason = Timeout
56472024-08-16T07:21:50.856ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
56482024-08-16T07:21:50.856ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 13 reason = Timeout
56492024-08-16T07:21:50.856ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
56502024-08-16T07:21:50.856ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
56512024-08-16T07:21:50.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
56522024-08-16T07:21:50.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
56532024-08-16T07:21:50.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
56542024-08-16T07:21:50.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
56552024-08-16T07:21:50.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
56562024-08-16T07:21:50.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56572024-08-16T07:21:50.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
56582024-08-16T07:21:50.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
56592024-08-16T07:21:50.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
56602024-08-16T07:21:50.857ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6d6264ea-5d56-4938-8c26-581ed0b9907b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a8440aa3-608b-4c08-b70c-6d92a9461396.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("aea2243f-052e-4953-bdfa-7c3368895dd2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("aea2243f-052e-4953-bdfa-7c3368895dd2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1374, tv_nsec: 234580855 } })
56612024-08-16T07:21:50.858ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("dec19c15-1a2d-47ac-9b9e-9f424d3a3464.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f9649eef-936b-4765-9810-da8662275db5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f9649eef-936b-4765-9810-da8662275db5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1374, tv_nsec: 234797470 } })
56622024-08-16T07:21:50.858ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56632024-08-16T07:21:50.858ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56642024-08-16T07:21:50.858ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
56652024-08-16T07:21:50.858ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56662024-08-16T07:21:50.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
56672024-08-16T07:21:50.859ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
56682024-08-16T07:21:50.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
56692024-08-16T07:21:50.860ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56702024-08-16T07:21:50.860ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-08-16 07:11:50.856143498 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
56712024-08-16T07:21:50.860ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
56722024-08-16T07:21:50.860ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 4.314109ms iteration = 6 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
56732024-08-16T07:21:50.860ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.37471ms iteration = 6 status = {"expiration":"2024-08-16T07:11:50.856143498Z","pruned":[]}
56742024-08-16T07:21:50.860ZWARNnexus (BackgroundTasks): phantom disk task done background_task = phantom_disks file = nexus/src/app/background/tasks/phantom_disks.rs:93
56752024-08-16T07:21:50.860ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.344711ms iteration = 11 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
56762024-08-16T07:21:50.860ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56772024-08-16T07:21:50.860ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56782024-08-16T07:21:50.861ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
56792024-08-16T07:21:50.861ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 4.955485ms iteration = 6 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
56802024-08-16T07:21:50.861ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1374, tv_nsec: 238077676 } })
56812024-08-16T07:21:50.861ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1374, tv_nsec: 238093536 } })
56822024-08-16T07:21:50.861ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
56832024-08-16T07:21:50.861ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
56842024-08-16T07:21:50.861ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
56852024-08-16T07:21:50.861ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
56862024-08-16T07:21:50.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
56872024-08-16T07:21:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
56882024-08-16T07:21:50.862ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 11 reason = Timeout
56892024-08-16T07:21:50.862ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 31 reason = Timeout
56902024-08-16T07:21:50.862ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 6 reason = Timeout
56912024-08-16T07:21:50.862ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
56922024-08-16T07:21:50.862ZINFOnexus (BackgroundTasks): lookup region port task started background_task = lookup_region_port file = nexus/src/app/background/tasks/lookup_region_port.rs:56
56932024-08-16T07:21:50.862ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56942024-08-16T07:21:50.862ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
56952024-08-16T07:21:50.862ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 11 reason = Timeout
56962024-08-16T07:21:50.862ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
56972024-08-16T07:21:50.862ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56982024-08-16T07:21:50.862ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 8 reason = Timeout
56992024-08-16T07:21:50.862ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 11 reason = Timeout
57002024-08-16T07:21:50.862ZINFOnexus (BackgroundTasks): region snapshot replacement start task started background_task = region_snapshot_replacement_start file = nexus/src/app/background/tasks/region_snapshot_replacement_start.rs:236
57012024-08-16T07:21:50.862ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
57022024-08-16T07:21:50.862ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 11 reason = Timeout
57032024-08-16T07:21:50.862ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 11 reason = Timeout
57042024-08-16T07:21:50.862ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57052024-08-16T07:21:50.862ZINFOnexus (BackgroundTasks): region snapshot replacement garbage collect task started background_task = region_snapshot_replacement_garbage_collection file = nexus/src/app/background/tasks/region_snapshot_replacement_garbage_collect.rs:133
57062024-08-16T07:21:50.862ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
57072024-08-16T07:21:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
57082024-08-16T07:21:50.862ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
57092024-08-16T07:21:50.862ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 11 reason = Timeout
57102024-08-16T07:21:50.862ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57112024-08-16T07:21:50.862ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 2 reason = Timeout
57122024-08-16T07:21:50.862ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
57132024-08-16T07:21:50.862ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
57142024-08-16T07:21:50.862ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 6 reason = Timeout
57152024-08-16T07:21:50.862ZINFOnexus (BackgroundTasks): Abandoned VMM reaper running background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:76
57162024-08-16T07:21:50.862ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
57172024-08-16T07:21:50.862ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 11 reason = Timeout
57182024-08-16T07:21:50.862ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
57192024-08-16T07:21:50.862ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 11 reason = Timeout
57202024-08-16T07:21:50.862ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
57212024-08-16T07:21:50.862ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
57222024-08-16T07:21:50.862ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 11 reason = Timeout
57232024-08-16T07:21:50.862ZWARNnexus (BackgroundTasks): region replacement task started background_task = region_replacement file = nexus/src/app/background/tasks/region_replacement.rs:64
57242024-08-16T07:21:50.862ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
57252024-08-16T07:21:50.862ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
57262024-08-16T07:21:50.862ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
57272024-08-16T07:21:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57282024-08-16T07:21:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57292024-08-16T07:21:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
57302024-08-16T07:21:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
57312024-08-16T07:21:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57322024-08-16T07:21:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
57332024-08-16T07:21:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
57342024-08-16T07:21:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
57352024-08-16T07:21:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
57362024-08-16T07:21:50.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
57372024-08-16T07:21:50.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
57382024-08-16T07:21:50.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
57392024-08-16T07:21:50.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
57402024-08-16T07:21:50.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
57412024-08-16T07:21:50.863ZWARNnexus (BackgroundTasks): physical disk adoption task started background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:100
57422024-08-16T07:21:50.863ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
57432024-08-16T07:21:50.863ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
57442024-08-16T07:21:50.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
57452024-08-16T07:21:50.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
57462024-08-16T07:21:50.864ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57472024-08-16T07:21:50.864ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57482024-08-16T07:21:50.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57492024-08-16T07:21:50.864ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
57502024-08-16T07:21:50.864ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57512024-08-16T07:21:50.864ZINFOnexus (BackgroundTasks): region snapshot replacement garbage collect task done background_task = region_snapshot_replacement_garbage_collection file = nexus/src/app/background/tasks/region_snapshot_replacement_garbage_collect.rs:147
57522024-08-16T07:21:50.864ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 2.472647ms iteration = 11 status = {"errors":[],"garbage_collect_requested":[]}
57532024-08-16T07:21:50.865ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
57542024-08-16T07:21:50.865ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
57552024-08-16T07:21:50.865ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57562024-08-16T07:21:50.865ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
57572024-08-16T07:21:50.865ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
57582024-08-16T07:21:50.865ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
57592024-08-16T07:21:50.865ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
57602024-08-16T07:21:50.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57612024-08-16T07:21:50.865ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
57622024-08-16T07:21:50.865ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.428629ms iteration = 31 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
57632024-08-16T07:21:50.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
57642024-08-16T07:21:50.865ZINFOnexus (BackgroundTasks): lookup region port task done background_task = lookup_region_port file = nexus/src/app/background/tasks/lookup_region_port.rs:150
57652024-08-16T07:21:50.865ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 3.499751ms iteration = 6 status = {"errors":[],"found_port_ok":[]}
57662024-08-16T07:21:50.865ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
57672024-08-16T07:21:50.865ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
57682024-08-16T07:21:50.865ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
57692024-08-16T07:21:50.865ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
57702024-08-16T07:21:50.866ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57712024-08-16T07:21:50.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
57722024-08-16T07:21:50.866ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
57732024-08-16T07:21:50.866ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
57742024-08-16T07:21:50.866ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
57752024-08-16T07:21:50.866ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57762024-08-16T07:21:50.866ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
57772024-08-16T07:21:50.866ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57782024-08-16T07:21:50.866ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
57792024-08-16T07:21:50.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
57802024-08-16T07:21:50.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57812024-08-16T07:21:50.866ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57822024-08-16T07:21:50.867ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57832024-08-16T07:21:50.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57842024-08-16T07:21:50.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
57852024-08-16T07:21:50.867ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
57862024-08-16T07:21:50.867ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
57872024-08-16T07:21:50.867ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57882024-08-16T07:21:50.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
57892024-08-16T07:21:50.868ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57902024-08-16T07:21:50.868ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
57912024-08-16T07:21:50.868ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
57922024-08-16T07:21:50.868ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57932024-08-16T07:21:50.868ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57942024-08-16T07:21:50.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
57952024-08-16T07:21:50.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57962024-08-16T07:21:50.869ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
57972024-08-16T07:21:50.869ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
57982024-08-16T07:21:50.869ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 7.010462ms iteration = 6 status = {"error":null,"error_count":0,"found":0,"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0}
57992024-08-16T07:21:50.869ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
58002024-08-16T07:21:50.869ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
58012024-08-16T07:21:50.869ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 7.251538ms iteration = 11 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
58022024-08-16T07:21:50.869ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58032024-08-16T07:21:50.870ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
58042024-08-16T07:21:50.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
58052024-08-16T07:21:50.870ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1374, tv_nsec: 247460182 } })
58062024-08-16T07:21:50.871ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
58072024-08-16T07:21:50.871ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
58082024-08-16T07:21:50.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
58092024-08-16T07:21:50.871ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
58102024-08-16T07:21:50.871ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
58112024-08-16T07:21:50.871ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
58122024-08-16T07:21:50.871ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
58132024-08-16T07:21:50.871ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58142024-08-16T07:21:50.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
58152024-08-16T07:21:50.871ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
58162024-08-16T07:21:50.871ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
58172024-08-16T07:21:50.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58182024-08-16T07:21:50.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
58192024-08-16T07:21:50.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
58202024-08-16T07:21:50.872ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
58212024-08-16T07:21:50.872ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
58222024-08-16T07:21:50.872ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
58232024-08-16T07:21:50.872ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58242024-08-16T07:21:50.872ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
58252024-08-16T07:21:50.872ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
58262024-08-16T07:21:50.872ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
58272024-08-16T07:21:50.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58282024-08-16T07:21:50.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
58292024-08-16T07:21:50.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
58302024-08-16T07:21:50.873ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
58312024-08-16T07:21:50.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
58322024-08-16T07:21:50.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
58332024-08-16T07:21:50.873ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58342024-08-16T07:21:50.873ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
58352024-08-16T07:21:50.873ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = ddebb22e-3faa-4936-9b3e-0f4d28827c0e dns_zone_name = oxide.test found_so_far = 0 version = 2
58362024-08-16T07:21:50.873ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
58372024-08-16T07:21:50.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
58382024-08-16T07:21:50.873ZWARNnexus (BackgroundTasks): region replacement task done background_task = region_replacement file = nexus/src/app/background/tasks/region_replacement.rs:185
58392024-08-16T07:21:50.873ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 11.381422ms iteration = 11 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
58402024-08-16T07:21:50.873ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
58412024-08-16T07:21:50.874ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
58422024-08-16T07:21:50.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
58432024-08-16T07:21:50.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
58442024-08-16T07:21:50.874ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58452024-08-16T07:21:50.874ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58462024-08-16T07:21:50.875ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58472024-08-16T07:21:50.875ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
58482024-08-16T07:21:50.875ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 2c55b660-f328-498e-b44c-73da75015ed4 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
58492024-08-16T07:21:50.875ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
58502024-08-16T07:21:50.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
58512024-08-16T07:21:50.876ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
58522024-08-16T07:21:50.876ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58532024-08-16T07:21:50.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58542024-08-16T07:21:50.876ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58552024-08-16T07:21:50.877ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
58562024-08-16T07:21:50.877ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
58572024-08-16T07:21:50.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
58582024-08-16T07:21:50.878ZINFOnexus (BackgroundTasks): region snapshot replacement start task done background_task = region_snapshot_replacement_start file = nexus/src/app/background/tasks/region_snapshot_replacement_start.rs:252
58592024-08-16T07:21:50.878ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 15.628321ms iteration = 11 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
58602024-08-16T07:21:50.878ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
58612024-08-16T07:21:50.878ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.023759ms iteration = 31 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
58622024-08-16T07:21:50.878ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58632024-08-16T07:21:50.878ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
58642024-08-16T07:21:50.878ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
58652024-08-16T07:21:50.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58662024-08-16T07:21:50.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
58672024-08-16T07:21:50.879ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
58682024-08-16T07:21:50.879ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 17.242848ms iteration = 11 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
58692024-08-16T07:21:50.879ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
58702024-08-16T07:21:50.879ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
58712024-08-16T07:21:50.879ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = ddebb22e-3faa-4936-9b3e-0f4d28827c0e dns_zone_name = oxide.test found_so_far = 1 version = 2
58722024-08-16T07:21:50.879ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
58732024-08-16T07:21:50.879ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-08-16 07:16:55.724690 UTC dns_group = external generation = 2
58742024-08-16T07:21:50.879ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 23.697898ms iteration = 6 status = {"generation":2}
58752024-08-16T07:21:50.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
58762024-08-16T07:21:50.880ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
58772024-08-16T07:21:50.880ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
58782024-08-16T07:21:50.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
58792024-08-16T07:21:50.880ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
58802024-08-16T07:21:50.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
58812024-08-16T07:21:50.881ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
58822024-08-16T07:21:50.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
58832024-08-16T07:21:50.882ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 2c55b660-f328-498e-b44c-73da75015ed4 dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
58842024-08-16T07:21:50.882ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
58852024-08-16T07:21:50.882ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-08-16 07:16:55.302318 UTC dns_group = internal generation = 1
58862024-08-16T07:21:50.882ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 26.482332ms iteration = 6 status = {"generation":1}
58872024-08-16T07:21:50.882ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58882024-08-16T07:21:50.885ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
58892024-08-16T07:21:50.885ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
58902024-08-16T07:21:50.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
58912024-08-16T07:21:50.887ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
58922024-08-16T07:21:50.887ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
58932024-08-16T07:21:50.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
58942024-08-16T07:21:50.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
58952024-08-16T07:21:50.888ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58962024-08-16T07:21:50.888ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
58972024-08-16T07:21:50.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
58982024-08-16T07:21:50.889ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
58992024-08-16T07:21:50.889ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59002024-08-16T07:21:50.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59012024-08-16T07:21:50.889ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59022024-08-16T07:21:50.890ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59032024-08-16T07:21:50.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59042024-08-16T07:21:50.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59052024-08-16T07:21:50.890ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59062024-08-16T07:21:50.890ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-08-16T07:16:49.943339Z, time_modified: 2024-08-16T07:16:49.943339Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, db_silo: Silo { identity: SiloIdentity { id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-16T07:16:55.682566Z, time_modified: 2024-08-16T07:16:55.682566Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "c9e400628d2b58a74b998fbfa44a053952e83a6e8d3c49e6518981bf7d4a006f" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, db_silo: Silo { identity: SiloIdentity { id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-16T07:16:55.682566Z, time_modified: 2024-08-16T07:16:55.682566Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "c9e400628d2b58a74b998fbfa44a053952e83a6e8d3c49e6518981bf7d4a006f" }] }) }
59072024-08-16T07:21:50.891ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 34.699222ms iteration = 6 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071","tls_certs":["c9e400628d2b58a74b998fbfa44a053952e83a6e8d3c49e6518981bf7d4a006f"]}},"default_endpoint":{"silo_id":"439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071","tls_certs":["c9e400628d2b58a74b998fbfa44a053952e83a6e8d3c49e6518981bf7d4a006f"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
59082024-08-16T07:21:50.891ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59092024-08-16T07:21:50.891ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59102024-08-16T07:21:50.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59112024-08-16T07:21:50.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59122024-08-16T07:21:50.892ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
59132024-08-16T07:21:50.892ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59142024-08-16T07:21:50.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59152024-08-16T07:21:50.892ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
59162024-08-16T07:21:50.892ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
59172024-08-16T07:21:50.892ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59182024-08-16T07:21:50.892ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 35.963161ms iteration = 6 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
59192024-08-16T07:21:50.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59202024-08-16T07:21:50.892ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59212024-08-16T07:21:50.893ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59222024-08-16T07:21:50.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59232024-08-16T07:21:50.894ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59242024-08-16T07:21:50.894ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae, lookup_type: ById(03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae) } result = Ok(())
59252024-08-16T07:21:50.894ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59262024-08-16T07:21:50.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59272024-08-16T07:21:50.896ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 33.705639ms iteration = 11 status = 0
59282024-08-16T07:21:50.897ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
59292024-08-16T07:21:50.897ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59302024-08-16T07:21:50.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59312024-08-16T07:21:50.898ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59322024-08-16T07:21:50.898ZWARNnexus (BackgroundTasks): physical disk adoption task done background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:174
59332024-08-16T07:21:50.898ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 42.353519ms iteration = 13 status = {"physical_disks_added":0}
59342024-08-16T07:21:50.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59352024-08-16T07:21:50.899ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59362024-08-16T07:21:50.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59372024-08-16T07:21:50.901ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59382024-08-16T07:21:50.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59392024-08-16T07:21:50.903ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59402024-08-16T07:21:50.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59412024-08-16T07:21:50.904ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59422024-08-16T07:21:50.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59432024-08-16T07:21:50.904ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59442024-08-16T07:21:50.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59452024-08-16T07:21:50.905ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59462024-08-16T07:21:50.908ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
59472024-08-16T07:21:50.908ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59482024-08-16T07:21:50.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59492024-08-16T07:21:50.909ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59502024-08-16T07:21:50.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59512024-08-16T07:21:50.910ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59522024-08-16T07:21:50.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59532024-08-16T07:21:50.911ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59542024-08-16T07:21:50.914ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
59552024-08-16T07:21:50.914ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59562024-08-16T07:21:50.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59572024-08-16T07:21:50.918ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59582024-08-16T07:21:50.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59592024-08-16T07:21:50.919ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59602024-08-16T07:21:50.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59612024-08-16T07:21:50.920ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59622024-08-16T07:21:50.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59632024-08-16T07:21:50.922ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59642024-08-16T07:21:50.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59652024-08-16T07:21:50.924ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59662024-08-16T07:21:50.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59672024-08-16T07:21:50.925ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59682024-08-16T07:21:50.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59692024-08-16T07:21:50.926ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59702024-08-16T07:21:50.926ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59712024-08-16T07:21:50.927ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59722024-08-16T07:21:50.930ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
59732024-08-16T07:21:50.930ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59742024-08-16T07:21:50.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59752024-08-16T07:21:50.931ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59762024-08-16T07:21:50.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59772024-08-16T07:21:50.932ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59782024-08-16T07:21:50.932ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59792024-08-16T07:21:50.933ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59802024-08-16T07:21:50.936ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
59812024-08-16T07:21:50.936ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59822024-08-16T07:21:50.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59832024-08-16T07:21:50.943ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 036a4ce6-ea03-4027-b4fc-46b08e5aab80, kind: Service { id: 0d900881-9285-4dbf-910f-5e4676c8f133 }, name: Name("nexus-0d900881-9285-4dbf-910f-5e4676c8f133"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 188, 237])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7d720059-2cc6-4a99-8f2a-da62f41fe70c, kind: Service { id: 09eed6fc-f2ea-4ebd-a66c-d8895818c00c }, name: Name("nexus-09eed6fc-f2ea-4ebd-a66c-d8895818c00c"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 154])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: addeeb4f-a7d0-4d63-8259-b305b18b5ab1, kind: Service { id: 30e79e9e-c63b-4bdf-99e7-c71a02ecefc5 }, name: Name("nexus-30e79e9e-c63b-4bdf-99e7-c71a02ecefc5"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 179, 154])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: 0394c19d-c776-4986-aadf-3eb1689e7bef, kind: Service { id: dec19c15-1a2d-47ac-9b9e-9f424d3a3464 }, name: Name("external-dns-dec19c15-1a2d-47ac-9b9e-9f424d3a3464"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 149])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e9bad3ae-7417-4456-8d3e-34e4cbaa5de1, kind: Service { id: f9649eef-936b-4765-9810-da8662275db5 }, name: Name("external-dns-f9649eef-936b-4765-9810-da8662275db5"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 132])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
59842024-08-16T07:21:50.943ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59852024-08-16T07:21:50.943ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59862024-08-16T07:21:50.944ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59872024-08-16T07:21:50.945ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
59882024-08-16T07:21:50.945ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59892024-08-16T07:21:50.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59902024-08-16T07:21:50.947ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
59912024-08-16T07:21:50.947ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 0394c19d-c776-4986-aadf-3eb1689e7bef, kind: Service { id: dec19c15-1a2d-47ac-9b9e-9f424d3a3464 }, name: Name("external-dns-dec19c15-1a2d-47ac-9b9e-9f424d3a3464"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 149])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e9bad3ae-7417-4456-8d3e-34e4cbaa5de1, kind: Service { id: f9649eef-936b-4765-9810-da8662275db5 }, name: Name("external-dns-f9649eef-936b-4765-9810-da8662275db5"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 132])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 036a4ce6-ea03-4027-b4fc-46b08e5aab80, kind: Service { id: 0d900881-9285-4dbf-910f-5e4676c8f133 }, name: Name("nexus-0d900881-9285-4dbf-910f-5e4676c8f133"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 188, 237])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7d720059-2cc6-4a99-8f2a-da62f41fe70c, kind: Service { id: 09eed6fc-f2ea-4ebd-a66c-d8895818c00c }, name: Name("nexus-09eed6fc-f2ea-4ebd-a66c-d8895818c00c"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 154])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: addeeb4f-a7d0-4d63-8259-b305b18b5ab1, kind: Service { id: 30e79e9e-c63b-4bdf-99e7-c71a02ecefc5 }, name: Name("nexus-30e79e9e-c63b-4bdf-99e7-c71a02ecefc5"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 179, 154])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
59922024-08-16T07:21:50.947ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
59932024-08-16T07:21:50.977ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 5202ec84-906e-4ddf-8339-3acb8222f359 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
59942024-08-16T07:21:50.978ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 5202ec84-906e-4ddf-8339-3acb8222f359 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
59952024-08-16T07:21:50.979ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1789 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 5202ec84-906e-4ddf-8339-3acb8222f359 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
59962024-08-16T07:21:51.001ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
59972024-08-16T07:21:51.020ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
59982024-08-16T07:21:51.020ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
59992024-08-16T07:21:51.021ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c45ced81-cf73-48e7-929b-b12c08976ce2", "content-length": "26", "date": "Fri, 16 Aug 2024 07:21:51 GMT"} })
60002024-08-16T07:21:51.021ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
60012024-08-16T07:21:51.024ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
60022024-08-16T07:21:51.039ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
60032024-08-16T07:21:51.059ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
60042024-08-16T07:21:51.060ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "2e3c238b-ea83-47f7-851d-3ab95bd527b9", "content-length": "691", "date": "Fri, 16 Aug 2024 07:21:51 GMT"} })
60052024-08-16T07:21:51.060ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
60062024-08-16T07:21:51.060ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
60072024-08-16T07:21:51.060ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
60082024-08-16T07:21:51.062ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 199.63896ms iteration = 11 status = {}
60092024-08-16T07:21:51.062ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
60102024-08-16T07:21:51.062ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
60112024-08-16T07:21:51.062ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ebaaf03d-99a2-42a2-ad70-aec1b1637656", "content-length": "26", "date": "Fri, 16 Aug 2024 07:21:51 GMT"} })
60122024-08-16T07:21:51.062ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
60132024-08-16T07:21:51.064ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
60142024-08-16T07:21:51.079ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
60152024-08-16T07:21:51.079ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "9464d82b-3643-4f08-ad5b-43edcdec0f91", "content-length": "372", "date": "Fri, 16 Aug 2024 07:21:51 GMT"} })
60162024-08-16T07:21:51.079ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60172024-08-16T07:21:51.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60182024-08-16T07:21:51.082ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60192024-08-16T07:21:51.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60202024-08-16T07:21:51.086ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60212024-08-16T07:21:51.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60222024-08-16T07:21:51.086ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a zone_address = fd00:1122:3344:101::2
60232024-08-16T07:21:51.086ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
60242024-08-16T07:21:51.087ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ba036239-fe80-4b2e-bbc6-eac62d316626", "content-length": "26", "date": "Fri, 16 Aug 2024 07:21:51 GMT"} })
60252024-08-16T07:21:51.087ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
60262024-08-16T07:21:51.088ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
60272024-08-16T07:21:51.089ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
60282024-08-16T07:21:51.089ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "ec5d4c61-3d84-4a7e-8a48-7b91cfd1d2a4", "date": "Fri, 16 Aug 2024 07:21:51 GMT"} })
60292024-08-16T07:21:51.090ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 228.381835ms iteration = 11 status = {}
60302024-08-16T07:21:51.141ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
60312024-08-16T07:21:51.142ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "ecaf1029-3fd1-40e7-bba9-3f24b499d916", "date": "Fri, 16 Aug 2024 07:21:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
60322024-08-16T07:21:51.142ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
60332024-08-16T07:21:51.144ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "e834a502-12ad-4612-97ef-958ea22b93e1", "date": "Fri, 16 Aug 2024 07:21:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
60342024-08-16T07:21:51.144ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
60352024-08-16T07:21:51.146ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
60362024-08-16T07:21:51.146ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 283.992589ms iteration = 8 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
60372024-08-16T07:21:51.155ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae, time_created: 2024-08-16T07:16:52.894284Z, time_modified: 2024-08-16T07:16:52.894284Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: e1b0d583-7b20-4a4b-97f9-9f83300aeb7a, is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
60382024-08-16T07:21:51.155ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
60392024-08-16T07:21:51.155ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
60402024-08-16T07:21:51.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
60412024-08-16T07:21:51.157ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
60422024-08-16T07:21:51.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
60432024-08-16T07:21:51.158ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60442024-08-16T07:21:51.160ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae, lookup_type: ById(03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae) } result = Ok(())
60452024-08-16T07:21:51.195ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
60462024-08-16T07:21:51.195ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "7f7f9cd2-ef5d-4291-b507-d54f84186cb8", "content-length": "1", "date": "Fri, 16 Aug 2024 07:21:51 GMT"} })
60472024-08-16T07:21:51.198ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
60482024-08-16T07:21:51.198ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
60492024-08-16T07:21:51.199ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 343.155855ms iteration = 11 status = null
60502024-08-16T07:21:51.281ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
60512024-08-16T07:21:51.283ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = service_firewall_rule_propagation result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", query: None, fragment: None }, status: 204, headers: {"x-request-id": "cf0ee720-ea38-4eb1-b1c8-0347d656d36a", "date": "Fri, 16 Aug 2024 07:21:51 GMT"} })
60522024-08-16T07:21:51.285ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
60532024-08-16T07:21:51.285ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 422.882946ms
60542024-08-16T07:21:51.285ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 422.892237ms iteration = 2 status = {}
60552024-08-16T07:21:51.290ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 433.761768ms iteration = 11 status = {}
60562024-08-16T07:21:51.290ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
60572024-08-16T07:21:51.334ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
60582024-08-16T07:21:51.334ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "86195543-3acf-4906-9e74-82cd9fdf0813", "date": "Fri, 16 Aug 2024 07:21:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
60592024-08-16T07:21:51.334ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
60602024-08-16T07:21:51.337ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "90d3399b-f697-4a90-b180-df8664caa498", "date": "Fri, 16 Aug 2024 07:21:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
60612024-08-16T07:21:51.337ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
60622024-08-16T07:21:51.339ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "c062dc6d-4935-4b56-8137-8442140ddaec", "date": "Fri, 16 Aug 2024 07:21:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
60632024-08-16T07:21:51.339ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
60642024-08-16T07:21:51.341ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
60652024-08-16T07:21:51.341ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 484.870058ms iteration = 8 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
60662024-08-16T07:21:51.353ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60672024-08-16T07:21:51.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60682024-08-16T07:21:51.354ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:146 port = SwitchPort { id: f13c0939-2c9d-4a0d-b006-5f3de89cc4fc, rack_id: e1b0d583-7b20-4a4b-97f9-9f83300aeb7a, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(4de7fcf8-2b1f-4b0e-ba6f-584e8a34addb) } rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0
60692024-08-16T07:21:51.355ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60702024-08-16T07:21:51.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60712024-08-16T07:21:51.361ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
60722024-08-16T07:21:51.363ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "67e9a676-94dc-48ef-982a-0546e96337fa", "content-length": "121", "date": "Fri, 16 Aug 2024 07:21:51 GMT"} })
60732024-08-16T07:21:51.363ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1663 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
60742024-08-16T07:21:51.363ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1690 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 4de7fcf8-2b1f-4b0e-ba6f-584e8a34addb
60752024-08-16T07:21:51.363ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None)}}
60762024-08-16T07:21:51.363ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None)}}
60772024-08-16T07:21:51.363ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {}
60782024-08-16T07:21:51.363ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {}
60792024-08-16T07:21:51.363ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
60802024-08-16T07:21:51.363ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60812024-08-16T07:21:51.364ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60822024-08-16T07:21:51.366ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
60832024-08-16T07:21:51.367ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a6577312-d131-4160-b0fa-a5fc2527dd82", "content-length": "2", "date": "Fri, 16 Aug 2024 07:21:51 GMT"} })
60842024-08-16T07:21:51.367ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
60852024-08-16T07:21:51.367ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6898b8cf-a71d-4921-a00b-1c57013e1ca8", "content-length": "52", "date": "Fri, 16 Aug 2024 07:21:51 GMT"} })
60862024-08-16T07:21:51.367ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0
60872024-08-16T07:21:51.367ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
60882024-08-16T07:21:51.432ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "2158a8e3-b441-4628-bdd8-985f90d93a12", "date": "Fri, 16 Aug 2024 07:21:51 GMT"} })
60892024-08-16T07:21:51.432ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch = Switch0
60902024-08-16T07:21:51.432ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
60912024-08-16T07:21:51.432ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "5b3f28cd-2852-4554-b301-2332e6ae11c1", "content-length": "494", "date": "Fri, 16 Aug 2024 07:21:51 GMT"} })
60922024-08-16T07:21:51.432ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60932024-08-16T07:21:51.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60942024-08-16T07:21:51.435ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60952024-08-16T07:21:51.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60962024-08-16T07:21:51.437ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60972024-08-16T07:21:51.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60982024-08-16T07:21:51.440ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60992024-08-16T07:21:51.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61002024-08-16T07:21:51.448ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 585.962672ms iteration = 11 status = {}
61012024-08-16T07:21:51.572ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 639 local_addr = [fd00:1122:3344:101::c]:53719 method = GET remote_addr = [fd00:1122:3344:101::d]:60737 req_id = 503c7312-39ca-49ad-9563-90bedfec1eb9 response_code = 200 uri = /0d900881-9285-4dbf-910f-5e4676c8f133
61022024-08-16T07:21:51.966ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64556 req_id = 07ebca57-fbdb-4d2d-b035-37005896d014 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
61032024-08-16T07:21:51.966ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64556 req_id = 07ebca57-fbdb-4d2d-b035-37005896d014 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
61042024-08-16T07:21:51.968ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2446 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64556 req_id = 07ebca57-fbdb-4d2d-b035-37005896d014 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
61052024-08-16T07:21:52.033ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 539a3488-35de-4cd8-95c9-e0fd4747c3c6 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
61062024-08-16T07:21:52.034ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 539a3488-35de-4cd8-95c9-e0fd4747c3c6 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
61072024-08-16T07:21:52.035ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2790 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 539a3488-35de-4cd8-95c9-e0fd4747c3c6 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
61082024-08-16T07:21:53.053ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 5ece9611-36f0-4ee7-886a-e9bdf7a45ad7 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
61092024-08-16T07:21:53.054ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 5ece9611-36f0-4ee7-886a-e9bdf7a45ad7 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
61102024-08-16T07:21:53.055ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1687 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 5ece9611-36f0-4ee7-886a-e9bdf7a45ad7 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
61112024-08-16T07:21:54.076ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 3aa1fafa-626f-495d-9243-5280cc513463 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
61122024-08-16T07:21:54.076ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 3aa1fafa-626f-495d-9243-5280cc513463 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
61132024-08-16T07:21:54.077ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2016 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 3aa1fafa-626f-495d-9243-5280cc513463 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
61142024-08-16T07:21:55.099ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = a89d9027-8ad9-4735-a98f-d8952830e810 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
61152024-08-16T07:21:55.099ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = a89d9027-8ad9-4735-a98f-d8952830e810 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
61162024-08-16T07:21:55.101ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2366 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = a89d9027-8ad9-4735-a98f-d8952830e810 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
61172024-08-16T07:21:56.121ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = e66716b0-4505-4df9-b3ab-0c2c9e7486e7 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
61182024-08-16T07:21:56.121ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = e66716b0-4505-4df9-b3ab-0c2c9e7486e7 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
61192024-08-16T07:21:56.123ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2552 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = e66716b0-4505-4df9-b3ab-0c2c9e7486e7 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
61202024-08-16T07:21:57.142ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 6a94b435-6999-4785-a662-a3aba3b34da7 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
61212024-08-16T07:21:57.143ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 6a94b435-6999-4785-a662-a3aba3b34da7 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
61222024-08-16T07:21:57.144ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1892 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 6a94b435-6999-4785-a662-a3aba3b34da7 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
61232024-08-16T07:21:58.164ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 5dce664e-e8ce-4366-a104-84f5218d3ecd roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
61242024-08-16T07:21:58.164ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 5dce664e-e8ce-4366-a104-84f5218d3ecd resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
61252024-08-16T07:21:58.166ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2022 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 5dce664e-e8ce-4366-a104-84f5218d3ecd response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
61262024-08-16T07:21:59.185ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = de78a2a5-3753-4bbd-a133-fd292f3c1979 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
61272024-08-16T07:21:59.185ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = de78a2a5-3753-4bbd-a133-fd292f3c1979 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
61282024-08-16T07:21:59.187ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1713 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = de78a2a5-3753-4bbd-a133-fd292f3c1979 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
61292024-08-16T07:22:00.208ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 31bd519d-8d78-4de9-b55a-7d53f33225f7 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
61302024-08-16T07:22:00.208ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 31bd519d-8d78-4de9-b55a-7d53f33225f7 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
61312024-08-16T07:22:00.210ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2217 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 31bd519d-8d78-4de9-b55a-7d53f33225f7 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
61322024-08-16T07:22:00.855ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 32 reason = Timeout
61332024-08-16T07:22:00.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61342024-08-16T07:22:00.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61352024-08-16T07:22:00.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61362024-08-16T07:22:00.860ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
61372024-08-16T07:22:00.860ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61382024-08-16T07:22:00.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61392024-08-16T07:22:00.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61402024-08-16T07:22:00.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61412024-08-16T07:22:00.861ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 32 reason = Timeout
61422024-08-16T07:22:00.861ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
61432024-08-16T07:22:00.861ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61442024-08-16T07:22:00.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61452024-08-16T07:22:00.862ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61462024-08-16T07:22:00.863ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61472024-08-16T07:22:00.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61482024-08-16T07:22:00.865ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
61492024-08-16T07:22:00.865ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61502024-08-16T07:22:00.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61512024-08-16T07:22:00.865ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
61522024-08-16T07:22:00.865ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.518482ms iteration = 32 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
61532024-08-16T07:22:00.871ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
61542024-08-16T07:22:00.871ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 15.856057ms iteration = 32 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
61552024-08-16T07:22:01.229ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 674842c9-e250-49c5-ae07-6698a39eb99d roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
61562024-08-16T07:22:01.229ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 674842c9-e250-49c5-ae07-6698a39eb99d resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
61572024-08-16T07:22:01.231ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2146 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 674842c9-e250-49c5-ae07-6698a39eb99d response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
61582024-08-16T07:22:01.572ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 693 local_addr = [fd00:1122:3344:101::c]:53719 method = GET remote_addr = [fd00:1122:3344:101::d]:60737 req_id = 6a1ff9a4-57db-48c9-bb74-87466f1bbe0d response_code = 200 uri = /0d900881-9285-4dbf-910f-5e4676c8f133
61592024-08-16T07:22:02.251ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 1af0b912-50a1-42a6-a358-b5f6484a318e roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
61602024-08-16T07:22:02.252ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 1af0b912-50a1-42a6-a358-b5f6484a318e resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
61612024-08-16T07:22:02.254ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2428 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 1af0b912-50a1-42a6-a358-b5f6484a318e response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
61622024-08-16T07:22:03.274ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = c69a4da3-2955-40c3-82f2-0deabde81c4c roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
61632024-08-16T07:22:03.274ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = c69a4da3-2955-40c3-82f2-0deabde81c4c resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
61642024-08-16T07:22:03.276ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2529 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = c69a4da3-2955-40c3-82f2-0deabde81c4c response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
61652024-08-16T07:22:04.298ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 52d458a9-119a-495b-8766-16538cf57647 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
61662024-08-16T07:22:04.298ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 52d458a9-119a-495b-8766-16538cf57647 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
61672024-08-16T07:22:04.299ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2051 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 52d458a9-119a-495b-8766-16538cf57647 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
61682024-08-16T07:22:05.319ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 468b6f4c-0f94-46b9-8f95-5d023d92acab roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
61692024-08-16T07:22:05.320ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 468b6f4c-0f94-46b9-8f95-5d023d92acab resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
61702024-08-16T07:22:05.322ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2577 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 468b6f4c-0f94-46b9-8f95-5d023d92acab response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
61712024-08-16T07:22:06.342ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = d7a20ae1-2c0f-49bf-9590-5b8c344f677a roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
61722024-08-16T07:22:06.342ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = d7a20ae1-2c0f-49bf-9590-5b8c344f677a resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
61732024-08-16T07:22:06.344ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1966 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = d7a20ae1-2c0f-49bf-9590-5b8c344f677a response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
61742024-08-16T07:22:07.364ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 0802c113-e093-4140-b29f-cf2742b5af8d roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
61752024-08-16T07:22:07.364ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 0802c113-e093-4140-b29f-cf2742b5af8d resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
61762024-08-16T07:22:07.366ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2222 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 0802c113-e093-4140-b29f-cf2742b5af8d response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
61772024-08-16T07:22:08.386ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 2aefb7c0-edc6-4ee9-8b5d-162deb23e3d3 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
61782024-08-16T07:22:08.386ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 2aefb7c0-edc6-4ee9-8b5d-162deb23e3d3 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
61792024-08-16T07:22:08.387ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1609 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 2aefb7c0-edc6-4ee9-8b5d-162deb23e3d3 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
61802024-08-16T07:22:09.406ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 1c0249d4-c06a-4626-93d6-64f0f28482e8 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
61812024-08-16T07:22:09.407ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 1c0249d4-c06a-4626-93d6-64f0f28482e8 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
61822024-08-16T07:22:09.408ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1857 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 1c0249d4-c06a-4626-93d6-64f0f28482e8 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
61832024-08-16T07:22:10.428ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = f13ab78e-be77-41d9-b078-a84a58c0d375 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
61842024-08-16T07:22:10.428ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = f13ab78e-be77-41d9-b078-a84a58c0d375 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
61852024-08-16T07:22:10.430ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2404 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = f13ab78e-be77-41d9-b078-a84a58c0d375 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
61862024-08-16T07:22:10.856ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 33 reason = Timeout
61872024-08-16T07:22:10.856ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61882024-08-16T07:22:10.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61892024-08-16T07:22:10.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61902024-08-16T07:22:10.860ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
61912024-08-16T07:22:10.860ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61922024-08-16T07:22:10.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61932024-08-16T07:22:10.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61942024-08-16T07:22:10.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61952024-08-16T07:22:10.861ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 33 reason = Timeout
61962024-08-16T07:22:10.861ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
61972024-08-16T07:22:10.861ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61982024-08-16T07:22:10.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61992024-08-16T07:22:10.862ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62002024-08-16T07:22:10.863ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
62012024-08-16T07:22:10.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
62022024-08-16T07:22:10.864ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
62032024-08-16T07:22:10.864ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62042024-08-16T07:22:10.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62052024-08-16T07:22:10.864ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
62062024-08-16T07:22:10.864ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.03878ms iteration = 33 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
62072024-08-16T07:22:10.870ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
62082024-08-16T07:22:10.870ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 14.164327ms iteration = 33 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
62092024-08-16T07:22:11.449ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 0f315086-35d7-4ceb-ac3c-ae226567a24e roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
62102024-08-16T07:22:11.450ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 0f315086-35d7-4ceb-ac3c-ae226567a24e resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
62112024-08-16T07:22:11.451ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1758 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 0f315086-35d7-4ceb-ac3c-ae226567a24e response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
62122024-08-16T07:22:11.572ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 950 local_addr = [fd00:1122:3344:101::c]:53719 method = GET remote_addr = [fd00:1122:3344:101::d]:60737 req_id = f475b2d0-a5f7-45f4-8256-083caac36958 response_code = 200 uri = /0d900881-9285-4dbf-910f-5e4676c8f133
62132024-08-16T07:22:12.472ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = a84521a8-ea47-4114-9170-479efd2d5797 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
62142024-08-16T07:22:12.472ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = a84521a8-ea47-4114-9170-479efd2d5797 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
62152024-08-16T07:22:12.473ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2310 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = a84521a8-ea47-4114-9170-479efd2d5797 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
62162024-08-16T07:22:13.495ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = c0730a89-9427-455e-8bdc-38443c81bc05 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
62172024-08-16T07:22:13.495ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = c0730a89-9427-455e-8bdc-38443c81bc05 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
62182024-08-16T07:22:13.497ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2229 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = c0730a89-9427-455e-8bdc-38443c81bc05 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
62192024-08-16T07:22:14.516ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = a8b5597f-5589-4e01-9dae-0430d0657508 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
62202024-08-16T07:22:14.516ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = a8b5597f-5589-4e01-9dae-0430d0657508 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
62212024-08-16T07:22:14.518ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1788 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = a8b5597f-5589-4e01-9dae-0430d0657508 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
62222024-08-16T07:22:15.539ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 73fed52c-1bc0-4409-bbc2-811ff3c92fff roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
62232024-08-16T07:22:15.539ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 73fed52c-1bc0-4409-bbc2-811ff3c92fff resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
62242024-08-16T07:22:15.541ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2692 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 73fed52c-1bc0-4409-bbc2-811ff3c92fff response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
62252024-08-16T07:22:16.561ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = c64f8bf9-30b7-47a5-9419-9074756f8bf4 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
62262024-08-16T07:22:16.561ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = c64f8bf9-30b7-47a5-9419-9074756f8bf4 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
62272024-08-16T07:22:16.563ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1965 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = c64f8bf9-30b7-47a5-9419-9074756f8bf4 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
62282024-08-16T07:22:17.581ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 61d182d7-c8b6-425b-81d7-77fff03d902c roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
62292024-08-16T07:22:17.581ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 61d182d7-c8b6-425b-81d7-77fff03d902c resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
62302024-08-16T07:22:17.583ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2070 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 61d182d7-c8b6-425b-81d7-77fff03d902c response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
62312024-08-16T07:22:18.603ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 0c9baab4-b230-4f5d-92f5-d5a0d66d6a19 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
62322024-08-16T07:22:18.604ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 0c9baab4-b230-4f5d-92f5-d5a0d66d6a19 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
62332024-08-16T07:22:18.606ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2955 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 0c9baab4-b230-4f5d-92f5-d5a0d66d6a19 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
62342024-08-16T07:22:19.626ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = b9951ba7-3467-41ba-b5f7-e1f56f4ea13a roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
62352024-08-16T07:22:19.626ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = b9951ba7-3467-41ba-b5f7-e1f56f4ea13a resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
62362024-08-16T07:22:19.627ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1806 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = b9951ba7-3467-41ba-b5f7-e1f56f4ea13a response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
62372024-08-16T07:22:20.646ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 797bcea5-2221-4823-aec3-8ce67b218077 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
62382024-08-16T07:22:20.646ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 797bcea5-2221-4823-aec3-8ce67b218077 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
62392024-08-16T07:22:20.648ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1626 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 797bcea5-2221-4823-aec3-8ce67b218077 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
62402024-08-16T07:22:20.856ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 12 reason = Timeout
62412024-08-16T07:22:20.856ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 12 reason = Timeout
62422024-08-16T07:22:20.856ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
62432024-08-16T07:22:20.856ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
62442024-08-16T07:22:20.856ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 12 reason = Timeout
62452024-08-16T07:22:20.856ZWARNnexus (BackgroundTasks): phantom disk task started background_task = phantom_disks file = nexus/src/app/background/tasks/phantom_disks.rs:46
62462024-08-16T07:22:20.856ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 34 reason = Timeout
62472024-08-16T07:22:20.856ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 14 reason = Timeout
62482024-08-16T07:22:20.856ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62492024-08-16T07:22:20.856ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
62502024-08-16T07:22:20.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
62512024-08-16T07:22:20.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
62522024-08-16T07:22:20.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62532024-08-16T07:22:20.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
62542024-08-16T07:22:20.858ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62552024-08-16T07:22:20.858ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62562024-08-16T07:22:20.858ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1404, tv_nsec: 235772396 } })
62572024-08-16T07:22:20.859ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
62582024-08-16T07:22:20.859ZWARNnexus (BackgroundTasks): phantom disk task done background_task = phantom_disks file = nexus/src/app/background/tasks/phantom_disks.rs:93
62592024-08-16T07:22:20.859ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.001799ms iteration = 12 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
62602024-08-16T07:22:20.859ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1404, tv_nsec: 236859731 } })
62612024-08-16T07:22:20.860ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
62622024-08-16T07:22:20.860ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
62632024-08-16T07:22:20.860ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
62642024-08-16T07:22:20.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
62652024-08-16T07:22:20.861ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
62662024-08-16T07:22:20.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62672024-08-16T07:22:20.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62682024-08-16T07:22:20.861ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 34 reason = Timeout
62692024-08-16T07:22:20.861ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
62702024-08-16T07:22:20.861ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 12 reason = Timeout
62712024-08-16T07:22:20.861ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
62722024-08-16T07:22:20.861ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
62732024-08-16T07:22:20.861ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 12 reason = Timeout
62742024-08-16T07:22:20.861ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
62752024-08-16T07:22:20.861ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
62762024-08-16T07:22:20.861ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 12 reason = Timeout
62772024-08-16T07:22:20.861ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
62782024-08-16T07:22:20.861ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 12 reason = Timeout
62792024-08-16T07:22:20.861ZWARNnexus (BackgroundTasks): region replacement task started background_task = region_replacement file = nexus/src/app/background/tasks/region_replacement.rs:64
62802024-08-16T07:22:20.861ZWARNnexus (BackgroundTasks): physical disk adoption task started background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:100
62812024-08-16T07:22:20.861ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
62822024-08-16T07:22:20.861ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 12 reason = Timeout
62832024-08-16T07:22:20.861ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
62842024-08-16T07:22:20.861ZINFOnexus (BackgroundTasks): region snapshot replacement garbage collect task started background_task = region_snapshot_replacement_garbage_collection file = nexus/src/app/background/tasks/region_snapshot_replacement_garbage_collect.rs:133
62852024-08-16T07:22:20.861ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
62862024-08-16T07:22:20.861ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 12 reason = Timeout
62872024-08-16T07:22:20.861ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 12 reason = Timeout
62882024-08-16T07:22:20.861ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62892024-08-16T07:22:20.861ZINFOnexus (BackgroundTasks): region snapshot replacement start task started background_task = region_snapshot_replacement_start file = nexus/src/app/background/tasks/region_snapshot_replacement_start.rs:236
62902024-08-16T07:22:20.861ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
62912024-08-16T07:22:20.861ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 12 reason = Timeout
62922024-08-16T07:22:20.861ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 12 reason = Timeout
62932024-08-16T07:22:20.861ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62942024-08-16T07:22:20.861ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62952024-08-16T07:22:20.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
62962024-08-16T07:22:20.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
62972024-08-16T07:22:20.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
62982024-08-16T07:22:20.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
62992024-08-16T07:22:20.862ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63002024-08-16T07:22:20.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
63012024-08-16T07:22:20.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63022024-08-16T07:22:20.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63032024-08-16T07:22:20.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63042024-08-16T07:22:20.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
63052024-08-16T07:22:20.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63062024-08-16T07:22:20.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
63072024-08-16T07:22:20.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
63082024-08-16T07:22:20.863ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63092024-08-16T07:22:20.863ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63102024-08-16T07:22:20.863ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63112024-08-16T07:22:20.863ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63122024-08-16T07:22:20.864ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63132024-08-16T07:22:20.864ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
63142024-08-16T07:22:20.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
63152024-08-16T07:22:20.865ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
63162024-08-16T07:22:20.865ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
63172024-08-16T07:22:20.865ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
63182024-08-16T07:22:20.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
63192024-08-16T07:22:20.865ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
63202024-08-16T07:22:20.865ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.990132ms iteration = 34 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
63212024-08-16T07:22:20.866ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
63222024-08-16T07:22:20.866ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
63232024-08-16T07:22:20.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
63242024-08-16T07:22:20.866ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
63252024-08-16T07:22:20.866ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
63262024-08-16T07:22:20.866ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
63272024-08-16T07:22:20.866ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
63282024-08-16T07:22:20.866ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
63292024-08-16T07:22:20.866ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63302024-08-16T07:22:20.866ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63312024-08-16T07:22:20.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
63322024-08-16T07:22:20.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
63332024-08-16T07:22:20.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63342024-08-16T07:22:20.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63352024-08-16T07:22:20.867ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63362024-08-16T07:22:20.867ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
63372024-08-16T07:22:20.867ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63382024-08-16T07:22:20.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63392024-08-16T07:22:20.867ZINFOnexus (BackgroundTasks): region snapshot replacement start task done background_task = region_snapshot_replacement_start file = nexus/src/app/background/tasks/region_snapshot_replacement_start.rs:252
63402024-08-16T07:22:20.867ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 6.008448ms iteration = 12 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
63412024-08-16T07:22:20.868ZINFOnexus (BackgroundTasks): region snapshot replacement garbage collect task done background_task = region_snapshot_replacement_garbage_collection file = nexus/src/app/background/tasks/region_snapshot_replacement_garbage_collect.rs:147
63422024-08-16T07:22:20.868ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 6.550811ms iteration = 12 status = {"errors":[],"garbage_collect_requested":[]}
63432024-08-16T07:22:20.868ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63442024-08-16T07:22:20.868ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1404, tv_nsec: 245750726 } })
63452024-08-16T07:22:20.869ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63462024-08-16T07:22:20.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63472024-08-16T07:22:20.870ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
63482024-08-16T07:22:20.870ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63492024-08-16T07:22:20.870ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
63502024-08-16T07:22:20.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63512024-08-16T07:22:20.870ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
63522024-08-16T07:22:20.870ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63532024-08-16T07:22:20.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63542024-08-16T07:22:20.881ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
63552024-08-16T07:22:20.881ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 20.030323ms iteration = 12 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
63562024-08-16T07:22:20.882ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
63572024-08-16T07:22:20.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
63582024-08-16T07:22:20.883ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
63592024-08-16T07:22:20.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
63602024-08-16T07:22:20.884ZWARNnexus (BackgroundTasks): physical disk adoption task done background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:174
63612024-08-16T07:22:20.884ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 27.761261ms iteration = 14 status = {"physical_disks_added":0}
63622024-08-16T07:22:20.884ZWARNnexus (BackgroundTasks): region replacement task done background_task = region_replacement file = nexus/src/app/background/tasks/region_replacement.rs:185
63632024-08-16T07:22:20.884ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 23.078383ms iteration = 12 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
63642024-08-16T07:22:20.887ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
63652024-08-16T07:22:20.887ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 31.578189ms iteration = 34 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
63662024-08-16T07:22:20.895ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63672024-08-16T07:22:20.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63682024-08-16T07:22:20.896ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63692024-08-16T07:22:20.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63702024-08-16T07:22:20.897ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63712024-08-16T07:22:20.900ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae, lookup_type: ById(03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae) } result = Ok(())
63722024-08-16T07:22:20.900ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63732024-08-16T07:22:20.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63742024-08-16T07:22:20.901ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 39.3752ms iteration = 12 status = 0
63752024-08-16T07:22:20.905ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
63762024-08-16T07:22:20.905ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
63772024-08-16T07:22:20.905ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 43.340451ms iteration = 12 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
63782024-08-16T07:22:20.917ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
63792024-08-16T07:22:20.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
63802024-08-16T07:22:20.918ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63812024-08-16T07:22:20.920ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
63822024-08-16T07:22:20.920ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
63832024-08-16T07:22:20.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
63842024-08-16T07:22:20.921ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63852024-08-16T07:22:20.922ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
63862024-08-16T07:22:20.922ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
63872024-08-16T07:22:20.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
63882024-08-16T07:22:20.977ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a zone_address = fd00:1122:3344:101::2
63892024-08-16T07:22:20.977ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
63902024-08-16T07:22:20.977ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "0c5deda1-115a-4191-8cec-4cc8d8d79556", "content-length": "26", "date": "Fri, 16 Aug 2024 07:22:20 GMT"} })
63912024-08-16T07:22:20.977ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
63922024-08-16T07:22:20.979ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
63932024-08-16T07:22:21.006ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
63942024-08-16T07:22:21.007ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "bb708b8c-261d-439a-81b3-e7ce1b569658", "content-length": "372", "date": "Fri, 16 Aug 2024 07:22:21 GMT"} })
63952024-08-16T07:22:21.007ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63962024-08-16T07:22:21.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63972024-08-16T07:22:21.009ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63982024-08-16T07:22:21.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63992024-08-16T07:22:21.012ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64002024-08-16T07:22:21.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64012024-08-16T07:22:21.014ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
64022024-08-16T07:22:21.014ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "3f9f8e7f-7d47-4865-8f14-1463e32a240e", "date": "Fri, 16 Aug 2024 07:22:21 GMT"} })
64032024-08-16T07:22:21.015ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 153.877564ms iteration = 12 status = {}
64042024-08-16T07:22:21.046ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
64052024-08-16T07:22:21.047ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "081a9532-4efb-4ce1-82eb-0a9a1ea91599", "content-length": "691", "date": "Fri, 16 Aug 2024 07:22:21 GMT"} })
64062024-08-16T07:22:21.047ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
64072024-08-16T07:22:21.047ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
64082024-08-16T07:22:21.047ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
64092024-08-16T07:22:21.048ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 186.936207ms iteration = 12 status = {}
64102024-08-16T07:22:21.069ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
64112024-08-16T07:22:21.069ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
64122024-08-16T07:22:21.069ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "09ebf50a-a7da-40bf-82e5-3f52e9e442d9", "content-length": "26", "date": "Fri, 16 Aug 2024 07:22:20 GMT"} })
64132024-08-16T07:22:21.069ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
64142024-08-16T07:22:21.071ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
64152024-08-16T07:22:21.074ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
64162024-08-16T07:22:21.074ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
64172024-08-16T07:22:21.074ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "47164e14-cdad-45f2-99f9-44f1da97e553", "content-length": "26", "date": "Fri, 16 Aug 2024 07:22:20 GMT"} })
64182024-08-16T07:22:21.075ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
64192024-08-16T07:22:21.076ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
64202024-08-16T07:22:21.166ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
64212024-08-16T07:22:21.166ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b998d161-6cbe-4ef5-bddd-8a481238bdf3", "content-length": "1", "date": "Fri, 16 Aug 2024 07:22:21 GMT"} })
64222024-08-16T07:22:21.168ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
64232024-08-16T07:22:21.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
64242024-08-16T07:22:21.170ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 314.139015ms iteration = 12 status = null
64252024-08-16T07:22:21.232ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 376.159498ms iteration = 12 status = {}
64262024-08-16T07:22:21.265ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64272024-08-16T07:22:21.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64282024-08-16T07:22:21.266ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:146 port = SwitchPort { id: f13c0939-2c9d-4a0d-b006-5f3de89cc4fc, rack_id: e1b0d583-7b20-4a4b-97f9-9f83300aeb7a, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(4de7fcf8-2b1f-4b0e-ba6f-584e8a34addb) } rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0
64292024-08-16T07:22:21.266ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64302024-08-16T07:22:21.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64312024-08-16T07:22:21.274ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
64322024-08-16T07:22:21.274ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "19da59de-90ad-4e19-87b0-8301e0fab2d4", "content-length": "121", "date": "Fri, 16 Aug 2024 07:22:21 GMT"} })
64332024-08-16T07:22:21.274ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1663 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
64342024-08-16T07:22:21.274ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1690 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 4de7fcf8-2b1f-4b0e-ba6f-584e8a34addb
64352024-08-16T07:22:21.275ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None)}}
64362024-08-16T07:22:21.275ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None)}}
64372024-08-16T07:22:21.275ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {}
64382024-08-16T07:22:21.275ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {}
64392024-08-16T07:22:21.275ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
64402024-08-16T07:22:21.275ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64412024-08-16T07:22:21.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64422024-08-16T07:22:21.276ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
64432024-08-16T07:22:21.277ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "8641332c-0ad0-4564-bb9b-a0ee896e7147", "content-length": "2", "date": "Fri, 16 Aug 2024 07:22:21 GMT"} })
64442024-08-16T07:22:21.277ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
64452024-08-16T07:22:21.277ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c6f3a26d-973b-4d64-bc2e-b12eb101881a", "content-length": "52", "date": "Fri, 16 Aug 2024 07:22:21 GMT"} })
64462024-08-16T07:22:21.277ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0
64472024-08-16T07:22:21.277ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
64482024-08-16T07:22:21.331ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "c8a0a54f-d91d-4d24-8152-6c18304f82c0", "date": "Fri, 16 Aug 2024 07:22:21 GMT"} })
64492024-08-16T07:22:21.331ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch = Switch0
64502024-08-16T07:22:21.331ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
64512024-08-16T07:22:21.331ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a3d5feff-06c7-420d-b879-2bb0fb90a7b6", "content-length": "494", "date": "Fri, 16 Aug 2024 07:22:21 GMT"} })
64522024-08-16T07:22:21.331ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64532024-08-16T07:22:21.331ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64542024-08-16T07:22:21.333ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64552024-08-16T07:22:21.333ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64562024-08-16T07:22:21.335ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64572024-08-16T07:22:21.335ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64582024-08-16T07:22:21.337ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64592024-08-16T07:22:21.337ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64602024-08-16T07:22:21.344ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 482.384621ms iteration = 12 status = {}
64612024-08-16T07:22:21.572ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1138 local_addr = [fd00:1122:3344:101::c]:53719 method = GET remote_addr = [fd00:1122:3344:101::d]:60737 req_id = 4ac1658e-0735-4607-8775-74b9677a8136 response_code = 200 uri = /0d900881-9285-4dbf-910f-5e4676c8f133
64622024-08-16T07:22:21.667ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 661c9de0-3d88-4518-9f06-182dfacfa1fa roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
64632024-08-16T07:22:21.667ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 661c9de0-3d88-4518-9f06-182dfacfa1fa resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
64642024-08-16T07:22:21.669ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2762 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 661c9de0-3d88-4518-9f06-182dfacfa1fa response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
64652024-08-16T07:22:22.000ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64556 req_id = d658a1d5-9054-47d8-a32d-e1919c0ff55b roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
64662024-08-16T07:22:22.000ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64556 req_id = d658a1d5-9054-47d8-a32d-e1919c0ff55b resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
64672024-08-16T07:22:22.002ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2842 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64556 req_id = d658a1d5-9054-47d8-a32d-e1919c0ff55b response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
64682024-08-16T07:22:22.687ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 66682b9d-3661-468a-807e-8b0c2f4fd79a roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
64692024-08-16T07:22:22.687ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 66682b9d-3661-468a-807e-8b0c2f4fd79a resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
64702024-08-16T07:22:22.689ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2303 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 66682b9d-3661-468a-807e-8b0c2f4fd79a response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
64712024-08-16T07:22:23.708ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = ecf87a34-0bf9-4ec5-8d46-1632eed29fcd roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
64722024-08-16T07:22:23.708ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = ecf87a34-0bf9-4ec5-8d46-1632eed29fcd resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
64732024-08-16T07:22:23.710ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2103 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = ecf87a34-0bf9-4ec5-8d46-1632eed29fcd response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
64742024-08-16T07:22:24.729ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 1a9f36de-e7fa-4b47-9c25-d06f10a3ec0c roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
64752024-08-16T07:22:24.729ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 1a9f36de-e7fa-4b47-9c25-d06f10a3ec0c resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
64762024-08-16T07:22:24.731ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2046 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 1a9f36de-e7fa-4b47-9c25-d06f10a3ec0c response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
64772024-08-16T07:22:25.751ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 5aeb2d62-0708-4fe1-971f-6551227547cc roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
64782024-08-16T07:22:25.751ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 5aeb2d62-0708-4fe1-971f-6551227547cc resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
64792024-08-16T07:22:25.753ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1627 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 5aeb2d62-0708-4fe1-971f-6551227547cc response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
64802024-08-16T07:22:26.772ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 4957f7c8-91be-490c-b7c6-b77e7bcc5149 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
64812024-08-16T07:22:26.773ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 4957f7c8-91be-490c-b7c6-b77e7bcc5149 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
64822024-08-16T07:22:26.774ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2171 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 4957f7c8-91be-490c-b7c6-b77e7bcc5149 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
64832024-08-16T07:22:27.793ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 1fb4b089-8a12-41fa-b331-05a2b9ab42ca roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
64842024-08-16T07:22:27.793ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 1fb4b089-8a12-41fa-b331-05a2b9ab42ca resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
64852024-08-16T07:22:27.795ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1698 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 1fb4b089-8a12-41fa-b331-05a2b9ab42ca response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
64862024-08-16T07:22:28.814ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = a7450988-04c0-41c9-8460-8a9cc108494a roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
64872024-08-16T07:22:28.814ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = a7450988-04c0-41c9-8460-8a9cc108494a resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
64882024-08-16T07:22:28.816ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2213 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = a7450988-04c0-41c9-8460-8a9cc108494a response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
64892024-08-16T07:22:29.836ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 4d189e5a-c219-4af4-aae3-274b894ef815 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
64902024-08-16T07:22:29.837ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 4d189e5a-c219-4af4-aae3-274b894ef815 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
64912024-08-16T07:22:29.838ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2358 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 4d189e5a-c219-4af4-aae3-274b894ef815 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
64922024-08-16T07:22:30.855ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 35 reason = Timeout
64932024-08-16T07:22:30.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64942024-08-16T07:22:30.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64952024-08-16T07:22:30.856ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 445ac3b5-993d-42d9-a0fe-67c75e98ea1e roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
64962024-08-16T07:22:30.856ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 445ac3b5-993d-42d9-a0fe-67c75e98ea1e resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
64972024-08-16T07:22:30.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64982024-08-16T07:22:30.858ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1751 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 445ac3b5-993d-42d9-a0fe-67c75e98ea1e response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
64992024-08-16T07:22:30.859ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
65002024-08-16T07:22:30.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65012024-08-16T07:22:30.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65022024-08-16T07:22:30.860ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65032024-08-16T07:22:30.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65042024-08-16T07:22:30.861ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 35 reason = Timeout
65052024-08-16T07:22:30.861ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
65062024-08-16T07:22:30.861ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65072024-08-16T07:22:30.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65082024-08-16T07:22:30.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65092024-08-16T07:22:30.862ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65102024-08-16T07:22:30.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65112024-08-16T07:22:30.864ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
65122024-08-16T07:22:30.864ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65132024-08-16T07:22:30.864ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
65142024-08-16T07:22:30.864ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 2.804885ms iteration = 35 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
65152024-08-16T07:22:30.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65162024-08-16T07:22:30.870ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
65172024-08-16T07:22:30.870ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 14.789312ms iteration = 35 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
65182024-08-16T07:22:31.571ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 557 local_addr = [fd00:1122:3344:101::c]:53719 method = GET remote_addr = [fd00:1122:3344:101::d]:60737 req_id = 3bbceef4-f931-4890-b300-42923e7b483c response_code = 200 uri = /0d900881-9285-4dbf-910f-5e4676c8f133
65192024-08-16T07:22:31.878ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = a0694531-b9fb-4862-af50-43713a66cd7f roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
65202024-08-16T07:22:31.878ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = a0694531-b9fb-4862-af50-43713a66cd7f resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
65212024-08-16T07:22:31.880ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2023 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = a0694531-b9fb-4862-af50-43713a66cd7f response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
65222024-08-16T07:22:32.900ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 09f2eea9-e921-4379-97f7-8095ab5b50ff roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
65232024-08-16T07:22:32.900ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 09f2eea9-e921-4379-97f7-8095ab5b50ff resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
65242024-08-16T07:22:32.902ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2488 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 09f2eea9-e921-4379-97f7-8095ab5b50ff response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
65252024-08-16T07:22:33.922ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 6d479b6b-2e7b-44b4-9223-f2c9cb8c13ee roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
65262024-08-16T07:22:33.923ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 6d479b6b-2e7b-44b4-9223-f2c9cb8c13ee resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
65272024-08-16T07:22:33.924ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2289 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 6d479b6b-2e7b-44b4-9223-f2c9cb8c13ee response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
65282024-08-16T07:22:34.944ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 5acb10f9-7b03-4477-878b-59438479dd7d roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
65292024-08-16T07:22:34.944ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 5acb10f9-7b03-4477-878b-59438479dd7d resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
65302024-08-16T07:22:34.945ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1683 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 5acb10f9-7b03-4477-878b-59438479dd7d response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
65312024-08-16T07:22:35.963ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 5bc0f2fe-10c1-4443-8f37-71f25a4f2aa2 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
65322024-08-16T07:22:35.963ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 5bc0f2fe-10c1-4443-8f37-71f25a4f2aa2 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
65332024-08-16T07:22:35.965ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2053 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 5bc0f2fe-10c1-4443-8f37-71f25a4f2aa2 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
65342024-08-16T07:22:36.985ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 0222eb5f-3568-4434-8a90-cb9d97605e7a roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
65352024-08-16T07:22:36.985ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 0222eb5f-3568-4434-8a90-cb9d97605e7a resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
65362024-08-16T07:22:36.987ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1687 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 0222eb5f-3568-4434-8a90-cb9d97605e7a response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
65372024-08-16T07:22:38.006ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = df13656d-f3c5-4e3e-8c76-091f9a5ca0af roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
65382024-08-16T07:22:38.006ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = df13656d-f3c5-4e3e-8c76-091f9a5ca0af resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
65392024-08-16T07:22:38.008ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1729 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = df13656d-f3c5-4e3e-8c76-091f9a5ca0af response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
65402024-08-16T07:22:39.028ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = bf477c57-c715-4561-b290-f9d0a2d08f57 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
65412024-08-16T07:22:39.029ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = bf477c57-c715-4561-b290-f9d0a2d08f57 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
65422024-08-16T07:22:39.030ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2929 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = bf477c57-c715-4561-b290-f9d0a2d08f57 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
65432024-08-16T07:22:40.051ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 49119144-a4a0-4130-95b5-5af91a07f45d roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
65442024-08-16T07:22:40.051ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 49119144-a4a0-4130-95b5-5af91a07f45d resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
65452024-08-16T07:22:40.052ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1595 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 49119144-a4a0-4130-95b5-5af91a07f45d response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
65462024-08-16T07:22:40.855ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 36 reason = Timeout
65472024-08-16T07:22:40.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65482024-08-16T07:22:40.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65492024-08-16T07:22:40.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65502024-08-16T07:22:40.859ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
65512024-08-16T07:22:40.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65522024-08-16T07:22:40.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65532024-08-16T07:22:40.860ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65542024-08-16T07:22:40.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65552024-08-16T07:22:40.861ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 36 reason = Timeout
65562024-08-16T07:22:40.861ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
65572024-08-16T07:22:40.861ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65582024-08-16T07:22:40.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65592024-08-16T07:22:40.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65602024-08-16T07:22:40.862ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65612024-08-16T07:22:40.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65622024-08-16T07:22:40.864ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
65632024-08-16T07:22:40.864ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65642024-08-16T07:22:40.864ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
65652024-08-16T07:22:40.864ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.04185ms iteration = 36 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
65662024-08-16T07:22:40.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65672024-08-16T07:22:40.869ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
65682024-08-16T07:22:40.869ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 14.30225ms iteration = 36 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
65692024-08-16T07:22:41.072ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = e58850a9-f7ae-45e7-8b3c-6e7ee2d568db roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
65702024-08-16T07:22:41.072ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = e58850a9-f7ae-45e7-8b3c-6e7ee2d568db resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
65712024-08-16T07:22:41.074ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1814 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = e58850a9-f7ae-45e7-8b3c-6e7ee2d568db response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
65722024-08-16T07:22:41.571ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 955 local_addr = [fd00:1122:3344:101::c]:53719 method = GET remote_addr = [fd00:1122:3344:101::d]:60737 req_id = f69959f0-06b5-479c-ac8f-95fb506b0b47 response_code = 200 uri = /0d900881-9285-4dbf-910f-5e4676c8f133
65732024-08-16T07:22:42.094ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = da4fe090-f528-4730-9d6d-d8a6d55ae7f1 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
65742024-08-16T07:22:42.095ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = da4fe090-f528-4730-9d6d-d8a6d55ae7f1 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
65752024-08-16T07:22:42.096ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2029 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = da4fe090-f528-4730-9d6d-d8a6d55ae7f1 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
65762024-08-16T07:22:43.116ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 9ea53a79-9e4c-49db-9b37-826ffa577699 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
65772024-08-16T07:22:43.117ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 9ea53a79-9e4c-49db-9b37-826ffa577699 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
65782024-08-16T07:22:43.118ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2060 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 9ea53a79-9e4c-49db-9b37-826ffa577699 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
65792024-08-16T07:22:44.139ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 36620883-c62b-408d-9934-754ea36edd20 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
65802024-08-16T07:22:44.139ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 36620883-c62b-408d-9934-754ea36edd20 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
65812024-08-16T07:22:44.141ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1724 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 36620883-c62b-408d-9934-754ea36edd20 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
65822024-08-16T07:22:45.160ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 9e4b3dbe-ff91-40b4-8b71-1d79322cbead roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
65832024-08-16T07:22:45.161ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 9e4b3dbe-ff91-40b4-8b71-1d79322cbead resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
65842024-08-16T07:22:45.162ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2190 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 9e4b3dbe-ff91-40b4-8b71-1d79322cbead response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
65852024-08-16T07:22:46.182ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 43c2d08f-6c76-4434-8b33-573c1e7690ed roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
65862024-08-16T07:22:46.183ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 43c2d08f-6c76-4434-8b33-573c1e7690ed resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
65872024-08-16T07:22:46.184ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2040 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 43c2d08f-6c76-4434-8b33-573c1e7690ed response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
65882024-08-16T07:22:47.204ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 395b6dbf-bae3-4628-95fe-bd3aa9c10389 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
65892024-08-16T07:22:47.204ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 395b6dbf-bae3-4628-95fe-bd3aa9c10389 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
65902024-08-16T07:22:47.206ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1820 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 395b6dbf-bae3-4628-95fe-bd3aa9c10389 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
65912024-08-16T07:22:48.224ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = bf90fea9-d657-4ca5-8938-e855ca905d20 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
65922024-08-16T07:22:48.224ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = bf90fea9-d657-4ca5-8938-e855ca905d20 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
65932024-08-16T07:22:48.226ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2281 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = bf90fea9-d657-4ca5-8938-e855ca905d20 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
65942024-08-16T07:22:49.246ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 39a970a0-7d83-4698-a60d-ee5673182557 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
65952024-08-16T07:22:49.246ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 39a970a0-7d83-4698-a60d-ee5673182557 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
65962024-08-16T07:22:49.248ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1997 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 39a970a0-7d83-4698-a60d-ee5673182557 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
65972024-08-16T07:22:50.267ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = e17efb0d-ab1b-40f0-a3f6-e4e4004b4cc6 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
65982024-08-16T07:22:50.267ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = e17efb0d-ab1b-40f0-a3f6-e4e4004b4cc6 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
65992024-08-16T07:22:50.269ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2354 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = e17efb0d-ab1b-40f0-a3f6-e4e4004b4cc6 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
66002024-08-16T07:22:50.855ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 7 reason = Timeout
66012024-08-16T07:22:50.855ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
66022024-08-16T07:22:50.855ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 37 reason = Timeout
66032024-08-16T07:22:50.855ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
66042024-08-16T07:22:50.855ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 7 reason = Timeout
66052024-08-16T07:22:50.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66062024-08-16T07:22:50.855ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 13 reason = Timeout
66072024-08-16T07:22:50.855ZWARNnexus (BackgroundTasks): phantom disk task started background_task = phantom_disks file = nexus/src/app/background/tasks/phantom_disks.rs:46
66082024-08-16T07:22:50.855ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 13 reason = Timeout
66092024-08-16T07:22:50.855ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 8 reason = Timeout
66102024-08-16T07:22:50.855ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:69 reason = blueprint disabled target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d
66112024-08-16T07:22:50.855ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
66122024-08-16T07:22:50.855ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.14\u{b5}s iteration = 8 status = {"error":"blueprint disabled","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d"}
66132024-08-16T07:22:50.855ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 7 reason = Timeout
66142024-08-16T07:22:50.855ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 9 reason = Timeout
66152024-08-16T07:22:50.855ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 7 reason = Timeout
66162024-08-16T07:22:50.855ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
66172024-08-16T07:22:50.855ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-08-16 07:12:50.855732373 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
66182024-08-16T07:22:50.855ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 13 reason = Timeout
66192024-08-16T07:22:50.855ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
66202024-08-16T07:22:50.855ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
66212024-08-16T07:22:50.855ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 7 reason = Timeout
66222024-08-16T07:22:50.855ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
66232024-08-16T07:22:50.855ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
66242024-08-16T07:22:50.855ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 7 reason = Timeout
66252024-08-16T07:22:50.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
66262024-08-16T07:22:50.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66272024-08-16T07:22:50.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
66282024-08-16T07:22:50.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
66292024-08-16T07:22:50.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
66302024-08-16T07:22:50.856ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 4 reason = Timeout
66312024-08-16T07:22:50.856ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 15 reason = Timeout
66322024-08-16T07:22:50.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
66332024-08-16T07:22:50.856ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 7 reason = Timeout
66342024-08-16T07:22:50.856ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
66352024-08-16T07:22:50.856ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
66362024-08-16T07:22:50.856ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
66372024-08-16T07:22:50.856ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
66382024-08-16T07:22:50.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
66392024-08-16T07:22:50.856ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6d6264ea-5d56-4938-8c26-581ed0b9907b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a8440aa3-608b-4c08-b70c-6d92a9461396.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("aea2243f-052e-4953-bdfa-7c3368895dd2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("aea2243f-052e-4953-bdfa-7c3368895dd2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1434, tv_nsec: 233383385 } })
66402024-08-16T07:22:50.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
66412024-08-16T07:22:50.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
66422024-08-16T07:22:50.856ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("dec19c15-1a2d-47ac-9b9e-9f424d3a3464.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f9649eef-936b-4765-9810-da8662275db5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f9649eef-936b-4765-9810-da8662275db5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1434, tv_nsec: 233546559 } })
66432024-08-16T07:22:50.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
66442024-08-16T07:22:50.856ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
66452024-08-16T07:22:50.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
66462024-08-16T07:22:50.856ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
66472024-08-16T07:22:50.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
66482024-08-16T07:22:50.856ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
66492024-08-16T07:22:50.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
66502024-08-16T07:22:50.857ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
66512024-08-16T07:22:50.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
66522024-08-16T07:22:50.857ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
66532024-08-16T07:22:50.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
66542024-08-16T07:22:50.857ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66552024-08-16T07:22:50.858ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
66562024-08-16T07:22:50.858ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 2.689912ms iteration = 7 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
66572024-08-16T07:22:50.858ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
66582024-08-16T07:22:50.858ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 2.842806ms iteration = 7 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
66592024-08-16T07:22:50.858ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
66602024-08-16T07:22:50.858ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66612024-08-16T07:22:50.859ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-08-16 07:12:50.855732373 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
66622024-08-16T07:22:50.859ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.429029ms iteration = 7 status = {"expiration":"2024-08-16T07:12:50.855732373Z","pruned":[]}
66632024-08-16T07:22:50.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
66642024-08-16T07:22:50.859ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1434, tv_nsec: 236346993 } })
66652024-08-16T07:22:50.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66662024-08-16T07:22:50.859ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
66672024-08-16T07:22:50.859ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
66682024-08-16T07:22:50.859ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66692024-08-16T07:22:50.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
66702024-08-16T07:22:50.860ZWARNnexus (BackgroundTasks): phantom disk task done background_task = phantom_disks file = nexus/src/app/background/tasks/phantom_disks.rs:93
66712024-08-16T07:22:50.860ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.505124ms iteration = 13 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
66722024-08-16T07:22:50.860ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66732024-08-16T07:22:50.860ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1434, tv_nsec: 237641123 } })
66742024-08-16T07:22:50.860ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66752024-08-16T07:22:50.860ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
66762024-08-16T07:22:50.861ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66772024-08-16T07:22:50.861ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 37 reason = Timeout
66782024-08-16T07:22:50.861ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
66792024-08-16T07:22:50.861ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
66802024-08-16T07:22:50.861ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 13 reason = Timeout
66812024-08-16T07:22:50.861ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
66822024-08-16T07:22:50.861ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 13 reason = Timeout
66832024-08-16T07:22:50.861ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66842024-08-16T07:22:50.861ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 13 reason = Timeout
66852024-08-16T07:22:50.861ZINFOnexus (BackgroundTasks): region snapshot replacement start task started background_task = region_snapshot_replacement_start file = nexus/src/app/background/tasks/region_snapshot_replacement_start.rs:236
66862024-08-16T07:22:50.861ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
66872024-08-16T07:22:50.861ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 13 reason = Timeout
66882024-08-16T07:22:50.861ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66892024-08-16T07:22:50.861ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 9 reason = Timeout
66902024-08-16T07:22:50.861ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
66912024-08-16T07:22:50.861ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 7 reason = Timeout
66922024-08-16T07:22:50.861ZINFOnexus (BackgroundTasks): Abandoned VMM reaper running background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:76
66932024-08-16T07:22:50.861ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
66942024-08-16T07:22:50.861ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 13 reason = Timeout
66952024-08-16T07:22:50.861ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66962024-08-16T07:22:50.861ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 13 reason = Timeout
66972024-08-16T07:22:50.861ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
66982024-08-16T07:22:50.861ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 13 reason = Timeout
66992024-08-16T07:22:50.861ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
67002024-08-16T07:22:50.861ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
67012024-08-16T07:22:50.861ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 13 reason = Timeout
67022024-08-16T07:22:50.861ZWARNnexus (BackgroundTasks): region replacement task started background_task = region_replacement file = nexus/src/app/background/tasks/region_replacement.rs:64
67032024-08-16T07:22:50.861ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
67042024-08-16T07:22:50.861ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 13 reason = Timeout
67052024-08-16T07:22:50.861ZINFOnexus (BackgroundTasks): region snapshot replacement garbage collect task started background_task = region_snapshot_replacement_garbage_collection file = nexus/src/app/background/tasks/region_snapshot_replacement_garbage_collect.rs:133
67062024-08-16T07:22:50.861ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
67072024-08-16T07:22:50.861ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 7 reason = Timeout
67082024-08-16T07:22:50.861ZINFOnexus (BackgroundTasks): lookup region port task started background_task = lookup_region_port file = nexus/src/app/background/tasks/lookup_region_port.rs:56
67092024-08-16T07:22:50.861ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
67102024-08-16T07:22:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
67112024-08-16T07:22:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67122024-08-16T07:22:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
67132024-08-16T07:22:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67142024-08-16T07:22:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67152024-08-16T07:22:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
67162024-08-16T07:22:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67172024-08-16T07:22:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
67182024-08-16T07:22:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
67192024-08-16T07:22:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
67202024-08-16T07:22:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
67212024-08-16T07:22:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
67222024-08-16T07:22:50.862ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
67232024-08-16T07:22:50.862ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
67242024-08-16T07:22:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
67252024-08-16T07:22:50.863ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
67262024-08-16T07:22:50.863ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
67272024-08-16T07:22:50.863ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 6.876678ms iteration = 7 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
67282024-08-16T07:22:50.863ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
67292024-08-16T07:22:50.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
67302024-08-16T07:22:50.863ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67312024-08-16T07:22:50.864ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
67322024-08-16T07:22:50.864ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67332024-08-16T07:22:50.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67342024-08-16T07:22:50.864ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
67352024-08-16T07:22:50.864ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
67362024-08-16T07:22:50.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
67372024-08-16T07:22:50.864ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
67382024-08-16T07:22:50.864ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
67392024-08-16T07:22:50.864ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
67402024-08-16T07:22:50.864ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
67412024-08-16T07:22:50.864ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.334586ms iteration = 37 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
67422024-08-16T07:22:50.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
67432024-08-16T07:22:50.865ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67442024-08-16T07:22:50.865ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67452024-08-16T07:22:50.865ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
67462024-08-16T07:22:50.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67472024-08-16T07:22:50.865ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
67482024-08-16T07:22:50.865ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
67492024-08-16T07:22:50.865ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
67502024-08-16T07:22:50.865ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
67512024-08-16T07:22:50.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
67522024-08-16T07:22:50.866ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67532024-08-16T07:22:50.866ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67542024-08-16T07:22:50.866ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
67552024-08-16T07:22:50.866ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
67562024-08-16T07:22:50.866ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
67572024-08-16T07:22:50.866ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
67582024-08-16T07:22:50.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
67592024-08-16T07:22:50.866ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
67602024-08-16T07:22:50.866ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67612024-08-16T07:22:50.866ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67622024-08-16T07:22:50.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67632024-08-16T07:22:50.867ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
67642024-08-16T07:22:50.867ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
67652024-08-16T07:22:50.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
67662024-08-16T07:22:50.867ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67672024-08-16T07:22:50.867ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67682024-08-16T07:22:50.867ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67692024-08-16T07:22:50.868ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67702024-08-16T07:22:50.868ZINFOnexus (BackgroundTasks): region snapshot replacement garbage collect task done background_task = region_snapshot_replacement_garbage_collection file = nexus/src/app/background/tasks/region_snapshot_replacement_garbage_collect.rs:147
67712024-08-16T07:22:50.868ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 6.765836ms iteration = 13 status = {"errors":[],"garbage_collect_requested":[]}
67722024-08-16T07:22:50.870ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
67732024-08-16T07:22:50.870ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67742024-08-16T07:22:50.870ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
67752024-08-16T07:22:50.870ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67762024-08-16T07:22:50.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67772024-08-16T07:22:50.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67782024-08-16T07:22:50.870ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
67792024-08-16T07:22:50.870ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
67802024-08-16T07:22:50.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
67812024-08-16T07:22:50.871ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67822024-08-16T07:22:50.871ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
67832024-08-16T07:22:50.871ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
67842024-08-16T07:22:50.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
67852024-08-16T07:22:50.871ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
67862024-08-16T07:22:50.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
67872024-08-16T07:22:50.871ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
67882024-08-16T07:22:50.871ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
67892024-08-16T07:22:50.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
67902024-08-16T07:22:50.872ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
67912024-08-16T07:22:50.872ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67922024-08-16T07:22:50.872ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
67932024-08-16T07:22:50.872ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
67942024-08-16T07:22:50.872ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
67952024-08-16T07:22:50.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67962024-08-16T07:22:50.872ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1434, tv_nsec: 249633510 } })
67972024-08-16T07:22:50.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
67982024-08-16T07:22:50.873ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
67992024-08-16T07:22:50.873ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
68002024-08-16T07:22:50.873ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
68012024-08-16T07:22:50.873ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
68022024-08-16T07:22:50.873ZINFOnexus (BackgroundTasks): region snapshot replacement start task done background_task = region_snapshot_replacement_start file = nexus/src/app/background/tasks/region_snapshot_replacement_start.rs:252
68032024-08-16T07:22:50.873ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 11.666629ms iteration = 13 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
68042024-08-16T07:22:50.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
68052024-08-16T07:22:50.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
68062024-08-16T07:22:50.873ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68072024-08-16T07:22:50.873ZWARNnexus (BackgroundTasks): physical disk adoption task started background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:100
68082024-08-16T07:22:50.873ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
68092024-08-16T07:22:50.873ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
68102024-08-16T07:22:50.873ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
68112024-08-16T07:22:50.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
68122024-08-16T07:22:50.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
68132024-08-16T07:22:50.874ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
68142024-08-16T07:22:50.874ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68152024-08-16T07:22:50.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
68162024-08-16T07:22:50.875ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
68172024-08-16T07:22:50.875ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
68182024-08-16T07:22:50.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
68192024-08-16T07:22:50.876ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
68202024-08-16T07:22:50.876ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
68212024-08-16T07:22:50.876ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 14.243629ms iteration = 13 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
68222024-08-16T07:22:50.876ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68232024-08-16T07:22:50.876ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
68242024-08-16T07:22:50.876ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
68252024-08-16T07:22:50.876ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 14.824732ms iteration = 7 status = {"error":null,"error_count":0,"found":0,"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0}
68262024-08-16T07:22:50.876ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
68272024-08-16T07:22:50.876ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
68282024-08-16T07:22:50.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
68292024-08-16T07:22:50.877ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
68302024-08-16T07:22:50.877ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = ddebb22e-3faa-4936-9b3e-0f4d28827c0e dns_zone_name = oxide.test found_so_far = 0 version = 2
68312024-08-16T07:22:50.877ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
68322024-08-16T07:22:50.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
68332024-08-16T07:22:50.877ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
68342024-08-16T07:22:50.877ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.132551ms iteration = 37 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
68352024-08-16T07:22:50.878ZINFOnexus (BackgroundTasks): lookup region port task done background_task = lookup_region_port file = nexus/src/app/background/tasks/lookup_region_port.rs:150
68362024-08-16T07:22:50.878ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 16.253935ms iteration = 7 status = {"errors":[],"found_port_ok":[]}
68372024-08-16T07:22:50.878ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68382024-08-16T07:22:50.878ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68392024-08-16T07:22:50.878ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 22.493019ms iteration = 4 status = {"nsuccess":5}
68402024-08-16T07:22:50.878ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
68412024-08-16T07:22:50.878ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 17.145356ms iteration = 13 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
68422024-08-16T07:22:50.879ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
68432024-08-16T07:22:50.879ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
68442024-08-16T07:22:50.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
68452024-08-16T07:22:50.881ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
68462024-08-16T07:22:50.881ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 2c55b660-f328-498e-b44c-73da75015ed4 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
68472024-08-16T07:22:50.881ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
68482024-08-16T07:22:50.881ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
68492024-08-16T07:22:50.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
68502024-08-16T07:22:50.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
68512024-08-16T07:22:50.881ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
68522024-08-16T07:22:50.881ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
68532024-08-16T07:22:50.881ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
68542024-08-16T07:22:50.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
68552024-08-16T07:22:50.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
68562024-08-16T07:22:50.881ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
68572024-08-16T07:22:50.881ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
68582024-08-16T07:22:50.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
68592024-08-16T07:22:50.882ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68602024-08-16T07:22:50.882ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68612024-08-16T07:22:50.883ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = ddebb22e-3faa-4936-9b3e-0f4d28827c0e dns_zone_name = oxide.test found_so_far = 1 version = 2
68622024-08-16T07:22:50.883ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
68632024-08-16T07:22:50.883ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-08-16 07:16:55.724690 UTC dns_group = external generation = 2
68642024-08-16T07:22:50.883ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 27.335691ms iteration = 7 status = {"generation":2}
68652024-08-16T07:22:50.883ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68662024-08-16T07:22:50.883ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
68672024-08-16T07:22:50.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
68682024-08-16T07:22:50.884ZWARNnexus (BackgroundTasks): physical disk adoption task done background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:174
68692024-08-16T07:22:50.884ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 28.046917ms iteration = 15 status = {"physical_disks_added":0}
68702024-08-16T07:22:50.884ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
68712024-08-16T07:22:50.884ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
68722024-08-16T07:22:50.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
68732024-08-16T07:22:50.885ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
68742024-08-16T07:22:50.885ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
68752024-08-16T07:22:50.885ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
68762024-08-16T07:22:50.885ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
68772024-08-16T07:22:50.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
68782024-08-16T07:22:50.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
68792024-08-16T07:22:50.886ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68802024-08-16T07:22:50.887ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 2c55b660-f328-498e-b44c-73da75015ed4 dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
68812024-08-16T07:22:50.887ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
68822024-08-16T07:22:50.887ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-08-16 07:16:55.302318 UTC dns_group = internal generation = 1
68832024-08-16T07:22:50.887ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 31.837706ms iteration = 7 status = {"generation":1}
68842024-08-16T07:22:50.888ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
68852024-08-16T07:22:50.888ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
68862024-08-16T07:22:50.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
68872024-08-16T07:22:50.899ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
68882024-08-16T07:22:50.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
68892024-08-16T07:22:50.900ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
68902024-08-16T07:22:50.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
68912024-08-16T07:22:50.901ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
68922024-08-16T07:22:50.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
68932024-08-16T07:22:50.901ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68942024-08-16T07:22:50.902ZWARNnexus (BackgroundTasks): region replacement task done background_task = region_replacement file = nexus/src/app/background/tasks/region_replacement.rs:185
68952024-08-16T07:22:50.902ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 40.552507ms iteration = 13 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
68962024-08-16T07:22:50.903ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae, lookup_type: ById(03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae) } result = Ok(())
68972024-08-16T07:22:50.903ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
68982024-08-16T07:22:50.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
68992024-08-16T07:22:50.905ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 43.330921ms iteration = 13 status = 0
69002024-08-16T07:22:50.925ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-08-16T07:16:49.943339Z, time_modified: 2024-08-16T07:16:49.943339Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, db_silo: Silo { identity: SiloIdentity { id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-16T07:16:55.682566Z, time_modified: 2024-08-16T07:16:55.682566Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "c9e400628d2b58a74b998fbfa44a053952e83a6e8d3c49e6518981bf7d4a006f" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, db_silo: Silo { identity: SiloIdentity { id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-16T07:16:55.682566Z, time_modified: 2024-08-16T07:16:55.682566Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "c9e400628d2b58a74b998fbfa44a053952e83a6e8d3c49e6518981bf7d4a006f" }] }) }
69012024-08-16T07:22:50.925ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 70.031668ms iteration = 7 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071","tls_certs":["c9e400628d2b58a74b998fbfa44a053952e83a6e8d3c49e6518981bf7d4a006f"]}},"default_endpoint":{"silo_id":"439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071","tls_certs":["c9e400628d2b58a74b998fbfa44a053952e83a6e8d3c49e6518981bf7d4a006f"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
69022024-08-16T07:22:50.996ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
69032024-08-16T07:22:51.033ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
69042024-08-16T07:22:51.033ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
69052024-08-16T07:22:51.033ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "42204530-4c59-4581-b8ee-c11cae765b35", "content-length": "26", "date": "Fri, 16 Aug 2024 07:22:51 GMT"} })
69062024-08-16T07:22:51.033ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
69072024-08-16T07:22:51.036ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
69082024-08-16T07:22:51.049ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
69092024-08-16T07:22:51.088ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a zone_address = fd00:1122:3344:101::2
69102024-08-16T07:22:51.088ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
69112024-08-16T07:22:51.088ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "0c608d3f-9f3e-4cda-aa92-78ff6218c667", "content-length": "26", "date": "Fri, 16 Aug 2024 07:22:51 GMT"} })
69122024-08-16T07:22:51.088ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
69132024-08-16T07:22:51.090ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
69142024-08-16T07:22:51.107ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
69152024-08-16T07:22:51.107ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "06390dcf-1a52-4369-a9f3-8aa9030286c5", "content-length": "372", "date": "Fri, 16 Aug 2024 07:22:51 GMT"} })
69162024-08-16T07:22:51.107ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69172024-08-16T07:22:51.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69182024-08-16T07:22:51.109ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69192024-08-16T07:22:51.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69202024-08-16T07:22:51.112ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69212024-08-16T07:22:51.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69222024-08-16T07:22:51.115ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
69232024-08-16T07:22:51.115ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "eda8f89c-0d79-4ffb-9f57-30d658d6ad56", "date": "Fri, 16 Aug 2024 07:22:51 GMT"} })
69242024-08-16T07:22:51.116ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 254.437676ms iteration = 13 status = {}
69252024-08-16T07:22:51.183ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
69262024-08-16T07:22:51.186ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
69272024-08-16T07:22:51.186ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
69282024-08-16T07:22:51.187ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6e2fe3fd-df78-4a90-b447-d5167d885222", "content-length": "26", "date": "Fri, 16 Aug 2024 07:22:51 GMT"} })
69292024-08-16T07:22:51.187ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
69302024-08-16T07:22:51.189ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
69312024-08-16T07:22:51.210ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
69322024-08-16T07:22:51.211ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a74b3f6d-1f16-4b4a-8ba9-0683724d7d05", "content-length": "691", "date": "Fri, 16 Aug 2024 07:22:51 GMT"} })
69332024-08-16T07:22:51.211ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
69342024-08-16T07:22:51.211ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
69352024-08-16T07:22:51.211ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
69362024-08-16T07:22:51.213ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 351.627581ms iteration = 13 status = {}
69372024-08-16T07:22:51.224ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
69382024-08-16T07:22:51.225ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "547227dd-6afa-452d-8029-4d3bb1e121a5", "content-length": "1", "date": "Fri, 16 Aug 2024 07:22:51 GMT"} })
69392024-08-16T07:22:51.226ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
69402024-08-16T07:22:51.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
69412024-08-16T07:22:51.228ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 372.449212ms iteration = 13 status = null
69422024-08-16T07:22:51.280ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
69432024-08-16T07:22:51.281ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "9722bb95-5c5f-49d1-b75e-7e7164006132", "date": "Fri, 16 Aug 2024 07:22:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
69442024-08-16T07:22:51.281ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
69452024-08-16T07:22:51.283ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "7a3ef9eb-6973-412b-bfbb-afd4d7ee29b5", "date": "Fri, 16 Aug 2024 07:22:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
69462024-08-16T07:22:51.283ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
69472024-08-16T07:22:51.286ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
69482024-08-16T07:22:51.286ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 424.591917ms iteration = 9 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
69492024-08-16T07:22:51.290ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 7f29f7c3-95e8-4127-9c2a-a88a93b3e6e7 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
69502024-08-16T07:22:51.291ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 7f29f7c3-95e8-4127-9c2a-a88a93b3e6e7 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
69512024-08-16T07:22:51.302ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 11279 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 7f29f7c3-95e8-4127-9c2a-a88a93b3e6e7 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
69522024-08-16T07:22:51.306ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
69532024-08-16T07:22:51.306ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "74b05a2d-eb61-4552-993b-1c1fa9057231", "date": "Fri, 16 Aug 2024 07:22:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
69542024-08-16T07:22:51.306ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
69552024-08-16T07:22:51.309ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "7376b306-a073-4fbb-9f3d-d74a117fa3d5", "date": "Fri, 16 Aug 2024 07:22:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
69562024-08-16T07:22:51.309ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
69572024-08-16T07:22:51.310ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "5b8c51ec-7d45-4842-8290-4bfad018914a", "date": "Fri, 16 Aug 2024 07:22:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
69582024-08-16T07:22:51.310ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
69592024-08-16T07:22:51.312ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
69602024-08-16T07:22:51.312ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 456.305598ms iteration = 9 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
69612024-08-16T07:22:51.338ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 482.291739ms iteration = 13 status = {}
69622024-08-16T07:22:51.366ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69632024-08-16T07:22:51.367ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69642024-08-16T07:22:51.367ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:146 port = SwitchPort { id: f13c0939-2c9d-4a0d-b006-5f3de89cc4fc, rack_id: e1b0d583-7b20-4a4b-97f9-9f83300aeb7a, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(4de7fcf8-2b1f-4b0e-ba6f-584e8a34addb) } rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0
69652024-08-16T07:22:51.368ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69662024-08-16T07:22:51.368ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69672024-08-16T07:22:51.375ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
69682024-08-16T07:22:51.377ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "24972806-b2aa-4c5f-b084-031a17b176cd", "content-length": "121", "date": "Fri, 16 Aug 2024 07:22:51 GMT"} })
69692024-08-16T07:22:51.377ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1663 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
69702024-08-16T07:22:51.377ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1690 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 4de7fcf8-2b1f-4b0e-ba6f-584e8a34addb
69712024-08-16T07:22:51.377ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None)}}
69722024-08-16T07:22:51.377ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None)}}
69732024-08-16T07:22:51.377ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {}
69742024-08-16T07:22:51.377ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {}
69752024-08-16T07:22:51.377ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
69762024-08-16T07:22:51.377ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69772024-08-16T07:22:51.377ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69782024-08-16T07:22:51.379ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
69792024-08-16T07:22:51.380ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c45cb26f-f2a8-46ec-a279-172a0d34fadf", "content-length": "2", "date": "Fri, 16 Aug 2024 07:22:51 GMT"} })
69802024-08-16T07:22:51.380ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
69812024-08-16T07:22:51.381ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "1807c5b9-7f2d-4128-bd90-ab00fbc08f0c", "content-length": "52", "date": "Fri, 16 Aug 2024 07:22:51 GMT"} })
69822024-08-16T07:22:51.381ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0
69832024-08-16T07:22:51.381ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
69842024-08-16T07:22:51.440ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "53801e93-f692-45d6-b105-f6e5490e64f8", "date": "Fri, 16 Aug 2024 07:22:51 GMT"} })
69852024-08-16T07:22:51.440ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch = Switch0
69862024-08-16T07:22:51.440ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
69872024-08-16T07:22:51.440ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "8010a86d-95e3-4973-86f3-938f4a10967d", "content-length": "494", "date": "Fri, 16 Aug 2024 07:22:51 GMT"} })
69882024-08-16T07:22:51.440ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69892024-08-16T07:22:51.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69902024-08-16T07:22:51.443ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69912024-08-16T07:22:51.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69922024-08-16T07:22:51.446ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69932024-08-16T07:22:51.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69942024-08-16T07:22:51.448ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69952024-08-16T07:22:51.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69962024-08-16T07:22:51.454ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 593.122728ms iteration = 13 status = {}
69972024-08-16T07:22:51.571ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 622 local_addr = [fd00:1122:3344:101::c]:53719 method = GET remote_addr = [fd00:1122:3344:101::d]:60737 req_id = 425524f8-64a4-48c3-808d-043f7c568ccf response_code = 200 uri = /0d900881-9285-4dbf-910f-5e4676c8f133
69982024-08-16T07:22:51.573ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
69992024-08-16T07:22:51.573ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
70002024-08-16T07:22:51.605ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
70012024-08-16T07:22:51.605ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:43167
70022024-08-16T07:22:51.605ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:43167 req_id = cbb9346c-edd7-41eb-ad9a-ecd8da190f86 roles = RoleSet { roles: {} } uri = /metrics/producers
70032024-08-16T07:22:51.605ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:43167 req_id = cbb9346c-edd7-41eb-ad9a-ecd8da190f86 resource = Database result = Ok(()) uri = /metrics/producers
70042024-08-16T07:22:51.638ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 62147b68-6c5f-49df-a144-ebe1b87f0e27
70052024-08-16T07:22:51.638ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:43167 req_id = cbb9346c-edd7-41eb-ad9a-ecd8da190f86 roles = RoleSet { roles: {} } uri = /metrics/producers
70062024-08-16T07:22:51.638ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:43167 req_id = cbb9346c-edd7-41eb-ad9a-ecd8da190f86 resource = Database result = Ok(()) uri = /metrics/producers
70072024-08-16T07:22:51.677ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 62147b68-6c5f-49df-a144-ebe1b87f0e27 uri = http://[fd00:1122:3344:101::d]:12223/producers
70082024-08-16T07:22:51.677ZDEBGnexus: client response oximeter-collector = 62147b68-6c5f-49df-a144-ebe1b87f0e27 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "5044bdec-0ead-4ad8-b432-9683d2a2d8d8", "date": "Fri, 16 Aug 2024 07:22:51 GMT"} })
70092024-08-16T07:22:51.677ZINFOnexus: assigned collector to new producer collector_id = 62147b68-6c5f-49df-a144-ebe1b87f0e27 file = nexus/src/app/oximeter.rs:125 producer_id = 0d900881-9285-4dbf-910f-5e4676c8f133
70102024-08-16T07:22:51.679ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 74497 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:43167 req_id = cbb9346c-edd7-41eb-ad9a-ecd8da190f86 response_code = 201 uri = /metrics/producers
70112024-08-16T07:22:51.679ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::c)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, status: 201, headers: {"content-type": "application/json", "x-request-id": "cbb9346c-edd7-41eb-ad9a-ecd8da190f86", "content-length": "41", "date": "Fri, 16 Aug 2024 07:22:51 GMT"} })
70122024-08-16T07:22:51.680ZDEBGnexus (producer-registration-task): registered with nexus successfully
70132024-08-16T07:22:51.680ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
70142024-08-16T07:22:52.033ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64556 req_id = 7bec3330-11ea-42ae-b74f-7caacb037342 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
70152024-08-16T07:22:52.033ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64556 req_id = 7bec3330-11ea-42ae-b74f-7caacb037342 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
70162024-08-16T07:22:52.035ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1895 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64556 req_id = 7bec3330-11ea-42ae-b74f-7caacb037342 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
70172024-08-16T07:22:52.326ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = f282d937-5ce4-45b5-aab5-93d7accd89d0 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
70182024-08-16T07:22:52.326ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = f282d937-5ce4-45b5-aab5-93d7accd89d0 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
70192024-08-16T07:22:52.328ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1656 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = f282d937-5ce4-45b5-aab5-93d7accd89d0 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
70202024-08-16T07:22:53.348ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 9f986896-909a-4a34-a079-e3e2e7feda19 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
70212024-08-16T07:22:53.348ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 9f986896-909a-4a34-a079-e3e2e7feda19 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
70222024-08-16T07:22:53.350ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2284 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 9f986896-909a-4a34-a079-e3e2e7feda19 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
70232024-08-16T07:22:54.370ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 675b9f79-eace-479d-8f87-dfd1707a9238 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
70242024-08-16T07:22:54.371ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 675b9f79-eace-479d-8f87-dfd1707a9238 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
70252024-08-16T07:22:54.372ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2223 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 675b9f79-eace-479d-8f87-dfd1707a9238 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
70262024-08-16T07:22:55.391ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 1d5c5394-72d6-49de-8332-c992bca9fdde roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
70272024-08-16T07:22:55.392ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 1d5c5394-72d6-49de-8332-c992bca9fdde resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
70282024-08-16T07:22:55.394ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2412 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 1d5c5394-72d6-49de-8332-c992bca9fdde response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
70292024-08-16T07:22:56.413ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = bf286d63-bf2e-450b-926e-af895264663e roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
70302024-08-16T07:22:56.414ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = bf286d63-bf2e-450b-926e-af895264663e resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
70312024-08-16T07:22:56.415ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1891 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = bf286d63-bf2e-450b-926e-af895264663e response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
70322024-08-16T07:22:57.435ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 1d18785d-a997-4b72-81aa-c45cc22330c6 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
70332024-08-16T07:22:57.436ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 1d18785d-a997-4b72-81aa-c45cc22330c6 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
70342024-08-16T07:22:57.437ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2077 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 1d18785d-a997-4b72-81aa-c45cc22330c6 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
70352024-08-16T07:22:58.456ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 1f5169f9-45b8-4f58-9fd6-5ffe9a575d02 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
70362024-08-16T07:22:58.456ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 1f5169f9-45b8-4f58-9fd6-5ffe9a575d02 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
70372024-08-16T07:22:58.458ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1976 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 1f5169f9-45b8-4f58-9fd6-5ffe9a575d02 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
70382024-08-16T07:22:59.477ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = c58b9c86-c475-418b-8a0f-902646c24405 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
70392024-08-16T07:22:59.477ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = c58b9c86-c475-418b-8a0f-902646c24405 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
70402024-08-16T07:22:59.478ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1862 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = c58b9c86-c475-418b-8a0f-902646c24405 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
70412024-08-16T07:23:00.498ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 56a9516f-fc3f-4c47-bcc5-767128ec8e84 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
70422024-08-16T07:23:00.499ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 56a9516f-fc3f-4c47-bcc5-767128ec8e84 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
70432024-08-16T07:23:00.500ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2192 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 56a9516f-fc3f-4c47-bcc5-767128ec8e84 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
70442024-08-16T07:23:00.855ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 38 reason = Timeout
70452024-08-16T07:23:00.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70462024-08-16T07:23:00.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70472024-08-16T07:23:00.858ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70482024-08-16T07:23:00.860ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
70492024-08-16T07:23:00.860ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70502024-08-16T07:23:00.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70512024-08-16T07:23:00.862ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 38 reason = Timeout
70522024-08-16T07:23:00.862ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
70532024-08-16T07:23:00.862ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
70542024-08-16T07:23:00.862ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70552024-08-16T07:23:00.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
70562024-08-16T07:23:00.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70572024-08-16T07:23:00.863ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
70582024-08-16T07:23:00.863ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70592024-08-16T07:23:00.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
70602024-08-16T07:23:00.865ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
70612024-08-16T07:23:00.865ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.416319ms iteration = 38 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
70622024-08-16T07:23:00.866ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
70632024-08-16T07:23:00.866ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70642024-08-16T07:23:00.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70652024-08-16T07:23:00.872ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
70662024-08-16T07:23:00.872ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 16.556122ms iteration = 38 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
70672024-08-16T07:23:01.520ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = acb81d9b-4b1d-43c2-9d5a-a2ac4d48d91e roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
70682024-08-16T07:23:01.521ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = acb81d9b-4b1d-43c2-9d5a-a2ac4d48d91e resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
70692024-08-16T07:23:01.522ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1945 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = acb81d9b-4b1d-43c2-9d5a-a2ac4d48d91e response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
70702024-08-16T07:23:01.680ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 891 local_addr = [fd00:1122:3344:101::c]:53719 method = GET remote_addr = [fd00:1122:3344:101::d]:60737 req_id = d62a5a80-793a-448f-a202-fc64dad99c6c response_code = 200 uri = /0d900881-9285-4dbf-910f-5e4676c8f133
70712024-08-16T07:23:02.542ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 98589dac-2bf1-421a-bcd6-3fd9d74b7e80 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
70722024-08-16T07:23:02.542ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 98589dac-2bf1-421a-bcd6-3fd9d74b7e80 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
70732024-08-16T07:23:02.543ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1886 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 98589dac-2bf1-421a-bcd6-3fd9d74b7e80 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
70742024-08-16T07:23:03.562ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 50c9be66-058d-40ce-b573-d839cf74a694 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
70752024-08-16T07:23:03.562ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 50c9be66-058d-40ce-b573-d839cf74a694 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
70762024-08-16T07:23:03.564ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2089 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 50c9be66-058d-40ce-b573-d839cf74a694 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
70772024-08-16T07:23:04.583ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = d455a1b8-c7bd-4aa6-a349-a92dedf80e26 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
70782024-08-16T07:23:04.583ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = d455a1b8-c7bd-4aa6-a349-a92dedf80e26 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
70792024-08-16T07:23:04.585ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2287 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = d455a1b8-c7bd-4aa6-a349-a92dedf80e26 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
70802024-08-16T07:23:05.604ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 73ee94ff-75f8-4127-9c23-b3109f8a0679 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
70812024-08-16T07:23:05.605ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 73ee94ff-75f8-4127-9c23-b3109f8a0679 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
70822024-08-16T07:23:05.606ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2446 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 73ee94ff-75f8-4127-9c23-b3109f8a0679 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
70832024-08-16T07:23:06.625ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 5b1b2585-ba11-4ec3-8848-7352b099fb63 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
70842024-08-16T07:23:06.625ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 5b1b2585-ba11-4ec3-8848-7352b099fb63 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
70852024-08-16T07:23:06.628ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 3123 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 5b1b2585-ba11-4ec3-8848-7352b099fb63 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
70862024-08-16T07:23:07.648ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 29ffd0a2-a211-49ef-8ba6-1244af1df110 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
70872024-08-16T07:23:07.648ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 29ffd0a2-a211-49ef-8ba6-1244af1df110 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
70882024-08-16T07:23:07.650ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2367 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 29ffd0a2-a211-49ef-8ba6-1244af1df110 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
70892024-08-16T07:23:08.670ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = b6b94155-e449-45b2-9acf-bace39352a11 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
70902024-08-16T07:23:08.671ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = b6b94155-e449-45b2-9acf-bace39352a11 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
70912024-08-16T07:23:08.672ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2187 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = b6b94155-e449-45b2-9acf-bace39352a11 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
70922024-08-16T07:23:09.692ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = efe1c607-8517-4546-bf66-945bfba67815 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
70932024-08-16T07:23:09.692ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = efe1c607-8517-4546-bf66-945bfba67815 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
70942024-08-16T07:23:09.694ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1841 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = efe1c607-8517-4546-bf66-945bfba67815 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
70952024-08-16T07:23:10.714ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 672030a2-e8d6-4cf9-ae7a-0660bf7a2832 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
70962024-08-16T07:23:10.714ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 672030a2-e8d6-4cf9-ae7a-0660bf7a2832 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
70972024-08-16T07:23:10.716ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2432 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 672030a2-e8d6-4cf9-ae7a-0660bf7a2832 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
70982024-08-16T07:23:10.855ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 39 reason = Timeout
70992024-08-16T07:23:10.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71002024-08-16T07:23:10.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71012024-08-16T07:23:10.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71022024-08-16T07:23:10.859ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
71032024-08-16T07:23:10.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71042024-08-16T07:23:10.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71052024-08-16T07:23:10.860ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71062024-08-16T07:23:10.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71072024-08-16T07:23:10.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71082024-08-16T07:23:10.861ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 39 reason = Timeout
71092024-08-16T07:23:10.861ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
71102024-08-16T07:23:10.861ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
71112024-08-16T07:23:10.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
71122024-08-16T07:23:10.863ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
71132024-08-16T07:23:10.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
71142024-08-16T07:23:10.863ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
71152024-08-16T07:23:10.863ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71162024-08-16T07:23:10.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71172024-08-16T07:23:10.864ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
71182024-08-16T07:23:10.864ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 2.687882ms iteration = 39 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
71192024-08-16T07:23:10.870ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
71202024-08-16T07:23:10.870ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 14.27836ms iteration = 39 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
71212024-08-16T07:23:11.680ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 699 local_addr = [fd00:1122:3344:101::c]:53719 method = GET remote_addr = [fd00:1122:3344:101::d]:60737 req_id = 09356ffd-b762-447b-9ef0-ba708996cc14 response_code = 200 uri = /0d900881-9285-4dbf-910f-5e4676c8f133
71222024-08-16T07:23:11.736ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = d68e7c7b-896f-4a01-848c-48013959d0b6 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
71232024-08-16T07:23:11.736ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = d68e7c7b-896f-4a01-848c-48013959d0b6 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
71242024-08-16T07:23:11.738ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1934 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = d68e7c7b-896f-4a01-848c-48013959d0b6 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
71252024-08-16T07:23:12.757ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = b9e2c075-125d-495d-b0f7-160b2fe40645 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
71262024-08-16T07:23:12.757ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = b9e2c075-125d-495d-b0f7-160b2fe40645 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
71272024-08-16T07:23:12.759ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2483 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = b9e2c075-125d-495d-b0f7-160b2fe40645 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
71282024-08-16T07:23:13.780ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = cb6fbd6d-c317-440f-aedb-40eab759eee3 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
71292024-08-16T07:23:13.780ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = cb6fbd6d-c317-440f-aedb-40eab759eee3 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
71302024-08-16T07:23:13.782ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2678 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = cb6fbd6d-c317-440f-aedb-40eab759eee3 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
71312024-08-16T07:23:14.801ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 8ce348a8-bf00-410e-a426-aa160cb57bbd roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
71322024-08-16T07:23:14.802ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 8ce348a8-bf00-410e-a426-aa160cb57bbd resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
71332024-08-16T07:23:14.804ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2672 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 8ce348a8-bf00-410e-a426-aa160cb57bbd response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
71342024-08-16T07:23:15.823ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 5c382943-6849-4d27-8814-99e4b29bb970 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
71352024-08-16T07:23:15.824ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 5c382943-6849-4d27-8814-99e4b29bb970 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
71362024-08-16T07:23:15.826ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2559 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 5c382943-6849-4d27-8814-99e4b29bb970 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
71372024-08-16T07:23:16.845ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 62af96fb-2c75-42dc-a087-7314f032b7e0 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
71382024-08-16T07:23:16.846ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 62af96fb-2c75-42dc-a087-7314f032b7e0 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
71392024-08-16T07:23:16.847ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2348 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 62af96fb-2c75-42dc-a087-7314f032b7e0 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
71402024-08-16T07:23:17.868ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = b69eac59-0c84-4330-ae28-29596df2acb9 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
71412024-08-16T07:23:17.868ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = b69eac59-0c84-4330-ae28-29596df2acb9 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
71422024-08-16T07:23:17.871ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 3439 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = b69eac59-0c84-4330-ae28-29596df2acb9 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
71432024-08-16T07:23:18.890ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 0e0b01bc-5891-4f14-b299-31f216ad1313 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
71442024-08-16T07:23:18.890ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 0e0b01bc-5891-4f14-b299-31f216ad1313 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
71452024-08-16T07:23:18.892ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 3286 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 0e0b01bc-5891-4f14-b299-31f216ad1313 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
71462024-08-16T07:23:19.912ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 3ddd1b61-f36d-408f-a049-a64499422fe4 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
71472024-08-16T07:23:19.912ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 3ddd1b61-f36d-408f-a049-a64499422fe4 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
71482024-08-16T07:23:19.914ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1887 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 3ddd1b61-f36d-408f-a049-a64499422fe4 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
71492024-08-16T07:23:20.855ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 14 reason = Timeout
71502024-08-16T07:23:20.855ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 14 reason = Timeout
71512024-08-16T07:23:20.855ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
71522024-08-16T07:23:20.855ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 40 reason = Timeout
71532024-08-16T07:23:20.855ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
71542024-08-16T07:23:20.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71552024-08-16T07:23:20.855ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 14 reason = Timeout
71562024-08-16T07:23:20.855ZWARNnexus (BackgroundTasks): phantom disk task started background_task = phantom_disks file = nexus/src/app/background/tasks/phantom_disks.rs:46
71572024-08-16T07:23:20.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71582024-08-16T07:23:20.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
71592024-08-16T07:23:20.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
71602024-08-16T07:23:20.856ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 16 reason = Timeout
71612024-08-16T07:23:20.856ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
71622024-08-16T07:23:20.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
71632024-08-16T07:23:20.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71642024-08-16T07:23:20.857ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71652024-08-16T07:23:20.857ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1464, tv_nsec: 235161209 } })
71662024-08-16T07:23:20.858ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1464, tv_nsec: 235297412 } })
71672024-08-16T07:23:20.858ZWARNnexus (BackgroundTasks): phantom disk task done background_task = phantom_disks file = nexus/src/app/background/tasks/phantom_disks.rs:93
71682024-08-16T07:23:20.858ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.03869ms iteration = 14 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
71692024-08-16T07:23:20.858ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
71702024-08-16T07:23:20.860ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
71712024-08-16T07:23:20.860ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
71722024-08-16T07:23:20.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
71732024-08-16T07:23:20.860ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
71742024-08-16T07:23:20.860ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71752024-08-16T07:23:20.860ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
71762024-08-16T07:23:20.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71772024-08-16T07:23:20.861ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 14 reason = Timeout
71782024-08-16T07:23:20.861ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 40 reason = Timeout
71792024-08-16T07:23:20.861ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
71802024-08-16T07:23:20.861ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
71812024-08-16T07:23:20.861ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 14 reason = Timeout
71822024-08-16T07:23:20.861ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
71832024-08-16T07:23:20.861ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71842024-08-16T07:23:20.861ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 14 reason = Timeout
71852024-08-16T07:23:20.861ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71862024-08-16T07:23:20.861ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 14 reason = Timeout
71872024-08-16T07:23:20.861ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71882024-08-16T07:23:20.861ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 14 reason = Timeout
71892024-08-16T07:23:20.861ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
71902024-08-16T07:23:20.861ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 14 reason = Timeout
71912024-08-16T07:23:20.861ZINFOnexus (BackgroundTasks): region snapshot replacement garbage collect task started background_task = region_snapshot_replacement_garbage_collection file = nexus/src/app/background/tasks/region_snapshot_replacement_garbage_collect.rs:133
71922024-08-16T07:23:20.861ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
71932024-08-16T07:23:20.861ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
71942024-08-16T07:23:20.861ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 14 reason = Timeout
71952024-08-16T07:23:20.861ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
71962024-08-16T07:23:20.861ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 14 reason = Timeout
71972024-08-16T07:23:20.861ZWARNnexus (BackgroundTasks): region replacement task started background_task = region_replacement file = nexus/src/app/background/tasks/region_replacement.rs:64
71982024-08-16T07:23:20.861ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
71992024-08-16T07:23:20.861ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 14 reason = Timeout
72002024-08-16T07:23:20.861ZINFOnexus (BackgroundTasks): region snapshot replacement start task started background_task = region_snapshot_replacement_start file = nexus/src/app/background/tasks/region_snapshot_replacement_start.rs:236
72012024-08-16T07:23:20.861ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
72022024-08-16T07:23:20.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
72032024-08-16T07:23:20.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
72042024-08-16T07:23:20.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72052024-08-16T07:23:20.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72062024-08-16T07:23:20.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
72072024-08-16T07:23:20.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
72082024-08-16T07:23:20.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72092024-08-16T07:23:20.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
72102024-08-16T07:23:20.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
72112024-08-16T07:23:20.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72122024-08-16T07:23:20.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
72132024-08-16T07:23:20.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
72142024-08-16T07:23:20.862ZWARNnexus (BackgroundTasks): physical disk adoption task started background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:100
72152024-08-16T07:23:20.862ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
72162024-08-16T07:23:20.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
72172024-08-16T07:23:20.862ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72182024-08-16T07:23:20.862ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
72192024-08-16T07:23:20.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
72202024-08-16T07:23:20.863ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72212024-08-16T07:23:20.863ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72222024-08-16T07:23:20.863ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72232024-08-16T07:23:20.863ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
72242024-08-16T07:23:20.863ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
72252024-08-16T07:23:20.863ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
72262024-08-16T07:23:20.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
72272024-08-16T07:23:20.864ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72282024-08-16T07:23:20.864ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
72292024-08-16T07:23:20.864ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.305816ms iteration = 40 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
72302024-08-16T07:23:20.866ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
72312024-08-16T07:23:20.866ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72322024-08-16T07:23:20.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72332024-08-16T07:23:20.866ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
72342024-08-16T07:23:20.866ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
72352024-08-16T07:23:20.866ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
72362024-08-16T07:23:20.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
72372024-08-16T07:23:20.866ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
72382024-08-16T07:23:20.866ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
72392024-08-16T07:23:20.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
72402024-08-16T07:23:20.866ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
72412024-08-16T07:23:20.866ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72422024-08-16T07:23:20.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
72432024-08-16T07:23:20.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72442024-08-16T07:23:20.867ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72452024-08-16T07:23:20.867ZINFOnexus (BackgroundTasks): region snapshot replacement garbage collect task done background_task = region_snapshot_replacement_garbage_collection file = nexus/src/app/background/tasks/region_snapshot_replacement_garbage_collect.rs:147
72462024-08-16T07:23:20.867ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 6.199103ms iteration = 14 status = {"errors":[],"garbage_collect_requested":[]}
72472024-08-16T07:23:20.867ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72482024-08-16T07:23:20.867ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
72492024-08-16T07:23:20.868ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
72502024-08-16T07:23:20.868ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
72512024-08-16T07:23:20.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
72522024-08-16T07:23:20.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
72532024-08-16T07:23:20.868ZWARNnexus (BackgroundTasks): region replacement task done background_task = region_replacement file = nexus/src/app/background/tasks/region_replacement.rs:185
72542024-08-16T07:23:20.868ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 6.887629ms iteration = 14 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
72552024-08-16T07:23:20.869ZINFOnexus (BackgroundTasks): region snapshot replacement start task done background_task = region_snapshot_replacement_start file = nexus/src/app/background/tasks/region_snapshot_replacement_start.rs:252
72562024-08-16T07:23:20.869ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 7.689587ms iteration = 14 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
72572024-08-16T07:23:20.869ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
72582024-08-16T07:23:20.869ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72592024-08-16T07:23:20.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72602024-08-16T07:23:20.869ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
72612024-08-16T07:23:20.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
72622024-08-16T07:23:20.870ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
72632024-08-16T07:23:20.870ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72642024-08-16T07:23:20.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72652024-08-16T07:23:20.871ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1464, tv_nsec: 248494717 } })
72662024-08-16T07:23:20.872ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
72672024-08-16T07:23:20.872ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
72682024-08-16T07:23:20.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
72692024-08-16T07:23:20.872ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
72702024-08-16T07:23:20.872ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 11.552747ms iteration = 14 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
72712024-08-16T07:23:20.882ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
72722024-08-16T07:23:20.882ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 27.574047ms iteration = 40 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
72732024-08-16T07:23:20.888ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
72742024-08-16T07:23:20.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
72752024-08-16T07:23:20.889ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72762024-08-16T07:23:20.891ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
72772024-08-16T07:23:20.891ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
72782024-08-16T07:23:20.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
72792024-08-16T07:23:20.892ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
72802024-08-16T07:23:20.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
72812024-08-16T07:23:20.892ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72822024-08-16T07:23:20.893ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
72832024-08-16T07:23:20.894ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
72842024-08-16T07:23:20.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
72852024-08-16T07:23:20.894ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
72862024-08-16T07:23:20.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
72872024-08-16T07:23:20.895ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72882024-08-16T07:23:20.897ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae, lookup_type: ById(03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae) } result = Ok(())
72892024-08-16T07:23:20.897ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
72902024-08-16T07:23:20.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
72912024-08-16T07:23:20.898ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 37.436845ms iteration = 14 status = 0
72922024-08-16T07:23:20.904ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
72932024-08-16T07:23:20.904ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
72942024-08-16T07:23:20.904ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 42.84972ms iteration = 14 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
72952024-08-16T07:23:20.909ZWARNnexus (BackgroundTasks): physical disk adoption task done background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:174
72962024-08-16T07:23:20.909ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 53.22934ms iteration = 16 status = {"physical_disks_added":0}
72972024-08-16T07:23:20.933ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 30ea3d3d-d26f-4c4c-9c31-61ad2ea72346 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
72982024-08-16T07:23:20.933ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 30ea3d3d-d26f-4c4c-9c31-61ad2ea72346 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
72992024-08-16T07:23:20.935ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1686 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 30ea3d3d-d26f-4c4c-9c31-61ad2ea72346 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
73002024-08-16T07:23:20.970ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
73012024-08-16T07:23:20.970ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
73022024-08-16T07:23:20.971ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "59161f57-02e1-4c66-a305-4f606a306747", "content-length": "26", "date": "Fri, 16 Aug 2024 07:23:20 GMT"} })
73032024-08-16T07:23:20.971ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
73042024-08-16T07:23:20.972ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
73052024-08-16T07:23:21.019ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a zone_address = fd00:1122:3344:101::2
73062024-08-16T07:23:21.019ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
73072024-08-16T07:23:21.020ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "47020983-f59e-48a3-86bb-2a577357e785", "content-length": "26", "date": "Fri, 16 Aug 2024 07:23:20 GMT"} })
73082024-08-16T07:23:21.020ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
73092024-08-16T07:23:21.022ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
73102024-08-16T07:23:21.046ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
73112024-08-16T07:23:21.046ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "68ed3332-5f7d-403d-ae45-a659f615aa9c", "content-length": "691", "date": "Fri, 16 Aug 2024 07:23:21 GMT"} })
73122024-08-16T07:23:21.046ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
73132024-08-16T07:23:21.046ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
73142024-08-16T07:23:21.046ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
73152024-08-16T07:23:21.048ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 187.568012ms iteration = 14 status = {}
73162024-08-16T07:23:21.050ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
73172024-08-16T07:23:21.050ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
73182024-08-16T07:23:21.051ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d6fe8a05-0002-4185-abe7-af48193ec975", "content-length": "26", "date": "Fri, 16 Aug 2024 07:23:20 GMT"} })
73192024-08-16T07:23:21.051ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
73202024-08-16T07:23:21.052ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
73212024-08-16T07:23:21.080ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
73222024-08-16T07:23:21.080ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "60f017bb-87fc-4184-a0bd-d8d17279018d", "content-length": "372", "date": "Fri, 16 Aug 2024 07:23:21 GMT"} })
73232024-08-16T07:23:21.081ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73242024-08-16T07:23:21.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73252024-08-16T07:23:21.082ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73262024-08-16T07:23:21.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73272024-08-16T07:23:21.085ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73282024-08-16T07:23:21.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73292024-08-16T07:23:21.088ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
73302024-08-16T07:23:21.088ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "77cf3d35-4c7b-4cd1-baac-57f38467ac1a", "date": "Fri, 16 Aug 2024 07:23:21 GMT"} })
73312024-08-16T07:23:21.090ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 228.712142ms iteration = 14 status = {}
73322024-08-16T07:23:21.109ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 254.033227ms iteration = 14 status = {}
73332024-08-16T07:23:21.209ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
73342024-08-16T07:23:21.210ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "aaaba1a4-a3bd-470b-a6ea-f9c8a1ce08c1", "content-length": "1", "date": "Fri, 16 Aug 2024 07:23:20 GMT"} })
73352024-08-16T07:23:21.212ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
73362024-08-16T07:23:21.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
73372024-08-16T07:23:21.214ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 358.772746ms iteration = 14 status = null
73382024-08-16T07:23:21.263ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73392024-08-16T07:23:21.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73402024-08-16T07:23:21.264ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:146 port = SwitchPort { id: f13c0939-2c9d-4a0d-b006-5f3de89cc4fc, rack_id: e1b0d583-7b20-4a4b-97f9-9f83300aeb7a, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(4de7fcf8-2b1f-4b0e-ba6f-584e8a34addb) } rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0
73412024-08-16T07:23:21.264ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73422024-08-16T07:23:21.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73432024-08-16T07:23:21.271ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
73442024-08-16T07:23:21.271ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "67c028e4-132c-458a-b618-d50633a89291", "content-length": "121", "date": "Fri, 16 Aug 2024 07:23:21 GMT"} })
73452024-08-16T07:23:21.271ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1663 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
73462024-08-16T07:23:21.271ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1690 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 4de7fcf8-2b1f-4b0e-ba6f-584e8a34addb
73472024-08-16T07:23:21.272ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None)}}
73482024-08-16T07:23:21.272ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None)}}
73492024-08-16T07:23:21.272ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {}
73502024-08-16T07:23:21.272ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {}
73512024-08-16T07:23:21.272ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
73522024-08-16T07:23:21.272ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73532024-08-16T07:23:21.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73542024-08-16T07:23:21.273ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
73552024-08-16T07:23:21.273ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "76a902ce-c889-4719-8ff3-af915277e0eb", "content-length": "2", "date": "Fri, 16 Aug 2024 07:23:21 GMT"} })
73562024-08-16T07:23:21.273ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
73572024-08-16T07:23:21.274ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "195e88f6-58a1-4fb5-bf84-b4070043a8df", "content-length": "52", "date": "Fri, 16 Aug 2024 07:23:21 GMT"} })
73582024-08-16T07:23:21.274ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0
73592024-08-16T07:23:21.274ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
73602024-08-16T07:23:21.331ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "c549a289-0f7e-4121-a218-0c067cdbe7e0", "date": "Fri, 16 Aug 2024 07:23:21 GMT"} })
73612024-08-16T07:23:21.331ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch = Switch0
73622024-08-16T07:23:21.331ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
73632024-08-16T07:23:21.331ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d42421d4-a983-44ef-a34a-8fc78c44341d", "content-length": "494", "date": "Fri, 16 Aug 2024 07:23:21 GMT"} })
73642024-08-16T07:23:21.331ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73652024-08-16T07:23:21.331ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73662024-08-16T07:23:21.334ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73672024-08-16T07:23:21.334ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73682024-08-16T07:23:21.336ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73692024-08-16T07:23:21.336ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73702024-08-16T07:23:21.338ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73712024-08-16T07:23:21.338ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73722024-08-16T07:23:21.344ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 483.471855ms iteration = 14 status = {}
73732024-08-16T07:23:21.680ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 998 local_addr = [fd00:1122:3344:101::c]:53719 method = GET remote_addr = [fd00:1122:3344:101::d]:60737 req_id = ffeb1e81-daea-4a25-939e-e1d87ea18b4d response_code = 200 uri = /0d900881-9285-4dbf-910f-5e4676c8f133
73742024-08-16T07:23:21.956ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 5c69e881-14a5-4676-8c39-25e03750ca2d roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
73752024-08-16T07:23:21.956ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 5c69e881-14a5-4676-8c39-25e03750ca2d resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
73762024-08-16T07:23:21.958ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2224 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 5c69e881-14a5-4676-8c39-25e03750ca2d response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
73772024-08-16T07:23:22.066ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64556 req_id = 66ed0264-22e3-41e0-a609-13dbedba81d3 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
73782024-08-16T07:23:22.067ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64556 req_id = 66ed0264-22e3-41e0-a609-13dbedba81d3 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
73792024-08-16T07:23:22.069ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2952 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64556 req_id = 66ed0264-22e3-41e0-a609-13dbedba81d3 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
73802024-08-16T07:23:22.977ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 01b65a92-ebad-4877-8577-a5ddefa713e4 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
73812024-08-16T07:23:22.977ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 01b65a92-ebad-4877-8577-a5ddefa713e4 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
73822024-08-16T07:23:22.979ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2277 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 01b65a92-ebad-4877-8577-a5ddefa713e4 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
73832024-08-16T07:23:23.997ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 54fb2348-cbb9-452b-98cb-719547c61240 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
73842024-08-16T07:23:23.998ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 54fb2348-cbb9-452b-98cb-719547c61240 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
73852024-08-16T07:23:23.999ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2136 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 54fb2348-cbb9-452b-98cb-719547c61240 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
73862024-08-16T07:23:25.019ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = f47ed158-f944-41a6-a5f4-22bb4c7c46c5 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
73872024-08-16T07:23:25.020ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = f47ed158-f944-41a6-a5f4-22bb4c7c46c5 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
73882024-08-16T07:23:25.021ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2286 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = f47ed158-f944-41a6-a5f4-22bb4c7c46c5 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
73892024-08-16T07:23:26.041ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 07016df8-72de-45a6-af69-efba69fd5e9f roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
73902024-08-16T07:23:26.042ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 07016df8-72de-45a6-af69-efba69fd5e9f resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
73912024-08-16T07:23:26.044ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2344 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 07016df8-72de-45a6-af69-efba69fd5e9f response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
73922024-08-16T07:23:27.062ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 9e36a45b-a69f-4303-b9ca-332c49630824 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
73932024-08-16T07:23:27.063ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 9e36a45b-a69f-4303-b9ca-332c49630824 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
73942024-08-16T07:23:27.065ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2451 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 9e36a45b-a69f-4303-b9ca-332c49630824 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
73952024-08-16T07:23:28.086ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 43be98af-794e-4b86-b375-2967f59c5c85 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
73962024-08-16T07:23:28.086ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 43be98af-794e-4b86-b375-2967f59c5c85 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
73972024-08-16T07:23:28.088ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2537 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 43be98af-794e-4b86-b375-2967f59c5c85 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
73982024-08-16T07:23:29.107ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 92d9d3a9-fcfb-480e-a561-93e003041bb1 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
73992024-08-16T07:23:29.108ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 92d9d3a9-fcfb-480e-a561-93e003041bb1 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
74002024-08-16T07:23:29.109ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2446 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 92d9d3a9-fcfb-480e-a561-93e003041bb1 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
74012024-08-16T07:23:30.129ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 1a3fb77b-1d88-4a99-a632-a1b3e66b1e05 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
74022024-08-16T07:23:30.129ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 1a3fb77b-1d88-4a99-a632-a1b3e66b1e05 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
74032024-08-16T07:23:30.131ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2355 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 1a3fb77b-1d88-4a99-a632-a1b3e66b1e05 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
74042024-08-16T07:23:30.855ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 41 reason = Timeout
74052024-08-16T07:23:30.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74062024-08-16T07:23:30.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74072024-08-16T07:23:30.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74082024-08-16T07:23:30.859ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
74092024-08-16T07:23:30.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74102024-08-16T07:23:30.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74112024-08-16T07:23:30.860ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74122024-08-16T07:23:30.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74132024-08-16T07:23:30.861ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 41 reason = Timeout
74142024-08-16T07:23:30.861ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
74152024-08-16T07:23:30.861ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
74162024-08-16T07:23:30.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
74172024-08-16T07:23:30.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74182024-08-16T07:23:30.862ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
74192024-08-16T07:23:30.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
74202024-08-16T07:23:30.863ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
74212024-08-16T07:23:30.863ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 2.673781ms iteration = 41 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
74222024-08-16T07:23:30.864ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
74232024-08-16T07:23:30.864ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74242024-08-16T07:23:30.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74252024-08-16T07:23:30.869ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
74262024-08-16T07:23:30.869ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 14.034834ms iteration = 41 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
74272024-08-16T07:23:31.151ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 29959d32-8891-4996-8f0f-67f659dd5af6 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
74282024-08-16T07:23:31.151ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 29959d32-8891-4996-8f0f-67f659dd5af6 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
74292024-08-16T07:23:31.153ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1831 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 29959d32-8891-4996-8f0f-67f659dd5af6 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
74302024-08-16T07:23:31.679ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 618 local_addr = [fd00:1122:3344:101::c]:53719 method = GET remote_addr = [fd00:1122:3344:101::d]:60737 req_id = d504f147-8408-4987-a07f-ada9c970d054 response_code = 200 uri = /0d900881-9285-4dbf-910f-5e4676c8f133
74312024-08-16T07:23:32.172ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 2b8e612e-5d9b-483a-9987-5cc8d7802aa9 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
74322024-08-16T07:23:32.172ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 2b8e612e-5d9b-483a-9987-5cc8d7802aa9 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
74332024-08-16T07:23:32.174ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2556 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 2b8e612e-5d9b-483a-9987-5cc8d7802aa9 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
74342024-08-16T07:23:33.204ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 54a1b39c-f1b1-4d07-93dc-c632f2375042 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
74352024-08-16T07:23:33.205ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 54a1b39c-f1b1-4d07-93dc-c632f2375042 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
74362024-08-16T07:23:33.206ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2447 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 54a1b39c-f1b1-4d07-93dc-c632f2375042 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
74372024-08-16T07:23:34.227ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 028bd8ee-edff-43d9-8fee-a83541c7b62c roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
74382024-08-16T07:23:34.227ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 028bd8ee-edff-43d9-8fee-a83541c7b62c resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
74392024-08-16T07:23:34.229ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2296 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 028bd8ee-edff-43d9-8fee-a83541c7b62c response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
74402024-08-16T07:23:35.248ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 63b9cd38-1608-4194-82ae-2242489ff68e roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
74412024-08-16T07:23:35.249ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 63b9cd38-1608-4194-82ae-2242489ff68e resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
74422024-08-16T07:23:35.250ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2234 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 63b9cd38-1608-4194-82ae-2242489ff68e response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
74432024-08-16T07:23:36.269ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 9523390e-0d52-40b7-9c62-164c66cabd5d roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
74442024-08-16T07:23:36.269ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 9523390e-0d52-40b7-9c62-164c66cabd5d resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
74452024-08-16T07:23:36.271ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2259 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 9523390e-0d52-40b7-9c62-164c66cabd5d response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
74462024-08-16T07:23:37.291ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 574a88a9-0cfd-4c56-9316-5eb98366d85f roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
74472024-08-16T07:23:37.292ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 574a88a9-0cfd-4c56-9316-5eb98366d85f resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
74482024-08-16T07:23:37.293ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2217 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 574a88a9-0cfd-4c56-9316-5eb98366d85f response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
74492024-08-16T07:23:38.313ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 2bee86a7-5bd3-4ebe-8ca8-059432307c1c roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
74502024-08-16T07:23:38.314ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 2bee86a7-5bd3-4ebe-8ca8-059432307c1c resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
74512024-08-16T07:23:38.315ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2496 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 2bee86a7-5bd3-4ebe-8ca8-059432307c1c response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
74522024-08-16T07:23:39.335ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 3e4040df-74e7-4dc1-8032-160a094c0468 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
74532024-08-16T07:23:39.335ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 3e4040df-74e7-4dc1-8032-160a094c0468 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
74542024-08-16T07:23:39.337ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1856 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 3e4040df-74e7-4dc1-8032-160a094c0468 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
74552024-08-16T07:23:40.088ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64556 req_id = d265e7d1-fc1c-4a88-830b-387c7f712ef2 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
74562024-08-16T07:23:40.089ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64556 req_id = d265e7d1-fc1c-4a88-830b-387c7f712ef2 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
74572024-08-16T07:23:40.091ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2511 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64556 req_id = d265e7d1-fc1c-4a88-830b-387c7f712ef2 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
74582024-08-16T07:23:40.093ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64556 req_id = 5fdf37ef-5302-4af3-8abd-b218546d11bd roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
74592024-08-16T07:23:40.093ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64556 req_id = 5fdf37ef-5302-4af3-8abd-b218546d11bd resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
74602024-08-16T07:23:40.095ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2251 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64556 req_id = 5fdf37ef-5302-4af3-8abd-b218546d11bd response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
74612024-08-16T07:23:40.356ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = fe74b5df-09f8-4a62-b2fb-44f8d37de9be roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
74622024-08-16T07:23:40.356ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = fe74b5df-09f8-4a62-b2fb-44f8d37de9be resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
74632024-08-16T07:23:40.359ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2482 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = fe74b5df-09f8-4a62-b2fb-44f8d37de9be response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
74642024-08-16T07:23:40.855ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 42 reason = Timeout
74652024-08-16T07:23:40.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74662024-08-16T07:23:40.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74672024-08-16T07:23:40.856ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74682024-08-16T07:23:40.859ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
74692024-08-16T07:23:40.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74702024-08-16T07:23:40.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74712024-08-16T07:23:40.860ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74722024-08-16T07:23:40.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74732024-08-16T07:23:40.861ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 42 reason = Timeout
74742024-08-16T07:23:40.861ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
74752024-08-16T07:23:40.861ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
74762024-08-16T07:23:40.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
74772024-08-16T07:23:40.862ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74782024-08-16T07:23:40.863ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
74792024-08-16T07:23:40.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
74802024-08-16T07:23:40.864ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
74812024-08-16T07:23:40.864ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74822024-08-16T07:23:40.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74832024-08-16T07:23:40.864ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
74842024-08-16T07:23:40.864ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.45616ms iteration = 42 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
74852024-08-16T07:23:40.870ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
74862024-08-16T07:23:40.870ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 15.023077ms iteration = 42 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
74872024-08-16T07:23:41.382ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 6a3f61d1-570f-4e2d-a560-6a347f3f5104 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
74882024-08-16T07:23:41.382ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 6a3f61d1-570f-4e2d-a560-6a347f3f5104 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
74892024-08-16T07:23:41.384ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2599 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 6a3f61d1-570f-4e2d-a560-6a347f3f5104 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
74902024-08-16T07:23:41.680ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1218 local_addr = [fd00:1122:3344:101::c]:53719 method = GET remote_addr = [fd00:1122:3344:101::d]:60737 req_id = 19edcf64-f077-4c73-b9ce-4fdf76762bb6 response_code = 200 uri = /0d900881-9285-4dbf-910f-5e4676c8f133
74912024-08-16T07:23:42.413ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 152564bd-61ae-4c3e-9586-0279d93085f8 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
74922024-08-16T07:23:42.413ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 152564bd-61ae-4c3e-9586-0279d93085f8 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
74932024-08-16T07:23:42.415ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2315 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 152564bd-61ae-4c3e-9586-0279d93085f8 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
74942024-08-16T07:23:43.435ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 20293a6c-aec1-4d8d-b455-ad0aa0ce21fb roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
74952024-08-16T07:23:43.435ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 20293a6c-aec1-4d8d-b455-ad0aa0ce21fb resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
74962024-08-16T07:23:43.437ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2288 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 20293a6c-aec1-4d8d-b455-ad0aa0ce21fb response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
74972024-08-16T07:23:44.460ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 4f9c1b68-4c35-4242-a62c-e45f6982b0c9 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
74982024-08-16T07:23:44.460ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 4f9c1b68-4c35-4242-a62c-e45f6982b0c9 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
74992024-08-16T07:23:44.462ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2620 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 4f9c1b68-4c35-4242-a62c-e45f6982b0c9 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
75002024-08-16T07:23:45.480ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = f1b57a18-d53c-4bc6-81dc-8a47d31aef07 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
75012024-08-16T07:23:45.480ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = f1b57a18-d53c-4bc6-81dc-8a47d31aef07 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
75022024-08-16T07:23:45.482ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2647 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = f1b57a18-d53c-4bc6-81dc-8a47d31aef07 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
75032024-08-16T07:23:46.502ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = b8b7f41b-05ea-43f1-a063-07bad478f57a roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
75042024-08-16T07:23:46.502ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = b8b7f41b-05ea-43f1-a063-07bad478f57a resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
75052024-08-16T07:23:46.504ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2409 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = b8b7f41b-05ea-43f1-a063-07bad478f57a response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
75062024-08-16T07:23:47.217ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1846 instance_id = 1a5c861f-b142-4554-9da6-cdc902ef7a3f local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 0cf6e496-975f-45c7-be02-aad19df20905 remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 208d8d99-dfa2-47ff-8f9b-a4aec8bac4dd uri = /instances/1a5c861f-b142-4554-9da6-cdc902ef7a3f vmm_state = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-08-16T07:23:47.186265420Z }
75072024-08-16T07:23:47.217ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 208d8d99-dfa2-47ff-8f9b-a4aec8bac4dd roles = RoleSet { roles: {} } uri = /instances/1a5c861f-b142-4554-9da6-cdc902ef7a3f
75082024-08-16T07:23:47.218ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 208d8d99-dfa2-47ff-8f9b-a4aec8bac4dd resource = Database result = Ok(()) uri = /instances/1a5c861f-b142-4554-9da6-cdc902ef7a3f
75092024-08-16T07:23:47.235ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 48461 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 208d8d99-dfa2-47ff-8f9b-a4aec8bac4dd response_code = 204 uri = /instances/1a5c861f-b142-4554-9da6-cdc902ef7a3f
75102024-08-16T07:23:47.236ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1846 instance_id = 1a5c861f-b142-4554-9da6-cdc902ef7a3f local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 0cf6e496-975f-45c7-be02-aad19df20905 remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 34da45e2-481c-4c8d-aca3-0b3eb8c36511 uri = /instances/1a5c861f-b142-4554-9da6-cdc902ef7a3f vmm_state = VmmRuntimeState { state: Running, gen: Generation(3), time_updated: 2024-08-16T07:23:47.235929007Z }
75112024-08-16T07:23:47.236ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 34da45e2-481c-4c8d-aca3-0b3eb8c36511 roles = RoleSet { roles: {} } uri = /instances/1a5c861f-b142-4554-9da6-cdc902ef7a3f
75122024-08-16T07:23:47.236ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 34da45e2-481c-4c8d-aca3-0b3eb8c36511 resource = Database result = Ok(()) uri = /instances/1a5c861f-b142-4554-9da6-cdc902ef7a3f
75132024-08-16T07:23:47.244ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 8387 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 34da45e2-481c-4c8d-aca3-0b3eb8c36511 response_code = 204 uri = /instances/1a5c861f-b142-4554-9da6-cdc902ef7a3f
75142024-08-16T07:23:47.525ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 45acb3d7-9c1d-4816-98ac-a343efa51c7a roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
75152024-08-16T07:23:47.525ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 45acb3d7-9c1d-4816-98ac-a343efa51c7a resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
75162024-08-16T07:23:47.527ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 3000 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 45acb3d7-9c1d-4816-98ac-a343efa51c7a response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
75172024-08-16T07:23:48.555ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 4500ca6e-2586-450e-ae08-182168e2d662 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
75182024-08-16T07:23:48.555ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 4500ca6e-2586-450e-ae08-182168e2d662 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
75192024-08-16T07:23:48.557ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 3071 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 4500ca6e-2586-450e-ae08-182168e2d662 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
75202024-08-16T07:23:49.576ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 6cd2fa24-2fb4-4aca-b6e2-61326c0e0f82 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
75212024-08-16T07:23:49.577ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 6cd2fa24-2fb4-4aca-b6e2-61326c0e0f82 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
75222024-08-16T07:23:49.578ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2450 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 6cd2fa24-2fb4-4aca-b6e2-61326c0e0f82 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
75232024-08-16T07:23:50.598ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = d150a355-4f3c-4f23-8a35-495f35b647dd roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
75242024-08-16T07:23:50.598ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = d150a355-4f3c-4f23-8a35-495f35b647dd resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
75252024-08-16T07:23:50.600ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2476 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = d150a355-4f3c-4f23-8a35-495f35b647dd response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
75262024-08-16T07:23:50.855ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 8 reason = Timeout
75272024-08-16T07:23:50.855ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
75282024-08-16T07:23:50.855ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 43 reason = Timeout
75292024-08-16T07:23:50.855ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
75302024-08-16T07:23:50.855ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 8 reason = Timeout
75312024-08-16T07:23:50.855ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-08-16 07:13:50.855660275 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
75322024-08-16T07:23:50.855ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
75332024-08-16T07:23:50.855ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 8 reason = Timeout
75342024-08-16T07:23:50.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75352024-08-16T07:23:50.855ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
75362024-08-16T07:23:50.855ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
75372024-08-16T07:23:50.855ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 10 reason = Timeout
75382024-08-16T07:23:50.855ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 8 reason = Timeout
75392024-08-16T07:23:50.855ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 15 reason = Timeout
75402024-08-16T07:23:50.855ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
75412024-08-16T07:23:50.855ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 15 reason = Timeout
75422024-08-16T07:23:50.855ZWARNnexus (BackgroundTasks): phantom disk task started background_task = phantom_disks file = nexus/src/app/background/tasks/phantom_disks.rs:46
75432024-08-16T07:23:50.855ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 8 reason = Timeout
75442024-08-16T07:23:50.855ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 15 reason = Timeout
75452024-08-16T07:23:50.855ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 9 reason = Timeout
75462024-08-16T07:23:50.855ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:69 reason = blueprint disabled target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d
75472024-08-16T07:23:50.855ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
75482024-08-16T07:23:50.855ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 8 reason = Timeout
75492024-08-16T07:23:50.855ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 9.37\u{b5}s iteration = 9 status = {"error":"blueprint disabled","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d"}
75502024-08-16T07:23:50.855ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
75512024-08-16T07:23:50.855ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 8 reason = Timeout
75522024-08-16T07:23:50.855ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 17 reason = Timeout
75532024-08-16T07:23:50.855ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
75542024-08-16T07:23:50.855ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
75552024-08-16T07:23:50.855ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
75562024-08-16T07:23:50.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
75572024-08-16T07:23:50.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
75582024-08-16T07:23:50.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75592024-08-16T07:23:50.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
75602024-08-16T07:23:50.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
75612024-08-16T07:23:50.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
75622024-08-16T07:23:50.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
75632024-08-16T07:23:50.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
75642024-08-16T07:23:50.856ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6d6264ea-5d56-4938-8c26-581ed0b9907b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a8440aa3-608b-4c08-b70c-6d92a9461396.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("aea2243f-052e-4953-bdfa-7c3368895dd2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("aea2243f-052e-4953-bdfa-7c3368895dd2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1494, tv_nsec: 233695119 } })
75652024-08-16T07:23:50.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
75662024-08-16T07:23:50.856ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("dec19c15-1a2d-47ac-9b9e-9f424d3a3464.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f9649eef-936b-4765-9810-da8662275db5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f9649eef-936b-4765-9810-da8662275db5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1494, tv_nsec: 233805042 } })
75672024-08-16T07:23:50.856ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
75682024-08-16T07:23:50.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
75692024-08-16T07:23:50.857ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75702024-08-16T07:23:50.858ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75712024-08-16T07:23:50.858ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75722024-08-16T07:23:50.858ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
75732024-08-16T07:23:50.858ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75742024-08-16T07:23:50.858ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
75752024-08-16T07:23:50.859ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 3.201204ms iteration = 8 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
75762024-08-16T07:23:50.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
75772024-08-16T07:23:50.859ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
75782024-08-16T07:23:50.859ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 3.378838ms iteration = 8 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
75792024-08-16T07:23:50.859ZWARNnexus (BackgroundTasks): phantom disk task done background_task = phantom_disks file = nexus/src/app/background/tasks/phantom_disks.rs:93
75802024-08-16T07:23:50.859ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.410779ms iteration = 15 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
75812024-08-16T07:23:50.859ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1494, tv_nsec: 236640697 } })
75822024-08-16T07:23:50.859ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75832024-08-16T07:23:50.860ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
75842024-08-16T07:23:50.860ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-08-16 07:13:50.855660275 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
75852024-08-16T07:23:50.860ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.713729ms iteration = 8 status = {"expiration":"2024-08-16T07:13:50.855660275Z","pruned":[]}
75862024-08-16T07:23:50.860ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1494, tv_nsec: 237765913 } })
75872024-08-16T07:23:50.860ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
75882024-08-16T07:23:50.860ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
75892024-08-16T07:23:50.860ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
75902024-08-16T07:23:50.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
75912024-08-16T07:23:50.860ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
75922024-08-16T07:23:50.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
75932024-08-16T07:23:50.861ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 15 reason = Timeout
75942024-08-16T07:23:50.861ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 8 reason = Timeout
75952024-08-16T07:23:50.861ZINFOnexus (BackgroundTasks): lookup region port task started background_task = lookup_region_port file = nexus/src/app/background/tasks/lookup_region_port.rs:56
75962024-08-16T07:23:50.861ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75972024-08-16T07:23:50.861ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
75982024-08-16T07:23:50.861ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 15 reason = Timeout
75992024-08-16T07:23:50.861ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 8 reason = Timeout
76002024-08-16T07:23:50.861ZINFOnexus (BackgroundTasks): Abandoned VMM reaper running background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:76
76012024-08-16T07:23:50.861ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76022024-08-16T07:23:50.861ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 10 reason = Timeout
76032024-08-16T07:23:50.861ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
76042024-08-16T07:23:50.861ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 15 reason = Timeout
76052024-08-16T07:23:50.861ZWARNnexus (BackgroundTasks): region replacement task started background_task = region_replacement file = nexus/src/app/background/tasks/region_replacement.rs:64
76062024-08-16T07:23:50.861ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
76072024-08-16T07:23:50.861ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 43 reason = Timeout
76082024-08-16T07:23:50.861ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
76092024-08-16T07:23:50.861ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
76102024-08-16T07:23:50.861ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 15 reason = Timeout
76112024-08-16T07:23:50.861ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
76122024-08-16T07:23:50.861ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 15 reason = Timeout
76132024-08-16T07:23:50.861ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
76142024-08-16T07:23:50.861ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
76152024-08-16T07:23:50.861ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 15 reason = Timeout
76162024-08-16T07:23:50.861ZINFOnexus (BackgroundTasks): region snapshot replacement garbage collect task started background_task = region_snapshot_replacement_garbage_collection file = nexus/src/app/background/tasks/region_snapshot_replacement_garbage_collect.rs:133
76172024-08-16T07:23:50.861ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
76182024-08-16T07:23:50.861ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 15 reason = Timeout
76192024-08-16T07:23:50.861ZINFOnexus (BackgroundTasks): region snapshot replacement start task started background_task = region_snapshot_replacement_start file = nexus/src/app/background/tasks/region_snapshot_replacement_start.rs:236
76202024-08-16T07:23:50.861ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
76212024-08-16T07:23:50.861ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 15 reason = Timeout
76222024-08-16T07:23:50.861ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
76232024-08-16T07:23:50.861ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 15 reason = Timeout
76242024-08-16T07:23:50.861ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
76252024-08-16T07:23:50.861ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
76262024-08-16T07:23:50.861ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
76272024-08-16T07:23:50.861ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
76282024-08-16T07:23:50.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
76292024-08-16T07:23:50.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
76302024-08-16T07:23:50.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76312024-08-16T07:23:50.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76322024-08-16T07:23:50.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
76332024-08-16T07:23:50.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
76342024-08-16T07:23:50.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
76352024-08-16T07:23:50.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76362024-08-16T07:23:50.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
76372024-08-16T07:23:50.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
76382024-08-16T07:23:50.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
76392024-08-16T07:23:50.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
76402024-08-16T07:23:50.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
76412024-08-16T07:23:50.862ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76422024-08-16T07:23:50.862ZWARNnexus (BackgroundTasks): physical disk adoption task started background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:100
76432024-08-16T07:23:50.862ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
76442024-08-16T07:23:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
76452024-08-16T07:23:50.863ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76462024-08-16T07:23:50.863ZINFOnexus (BackgroundTasks): lookup region port task done background_task = lookup_region_port file = nexus/src/app/background/tasks/lookup_region_port.rs:150
76472024-08-16T07:23:50.863ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 2.102068ms iteration = 8 status = {"errors":[],"found_port_ok":[]}
76482024-08-16T07:23:50.863ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
76492024-08-16T07:23:50.863ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76502024-08-16T07:23:50.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76512024-08-16T07:23:50.863ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76522024-08-16T07:23:50.864ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76532024-08-16T07:23:50.864ZINFOnexus (BackgroundTasks): region snapshot replacement garbage collect task done background_task = region_snapshot_replacement_garbage_collection file = nexus/src/app/background/tasks/region_snapshot_replacement_garbage_collect.rs:147
76542024-08-16T07:23:50.864ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 2.906377ms iteration = 15 status = {"errors":[],"garbage_collect_requested":[]}
76552024-08-16T07:23:50.864ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
76562024-08-16T07:23:50.864ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76572024-08-16T07:23:50.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76582024-08-16T07:23:50.865ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
76592024-08-16T07:23:50.865ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
76602024-08-16T07:23:50.865ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 9.250774ms iteration = 8 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
76612024-08-16T07:23:50.865ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
76622024-08-16T07:23:50.865ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
76632024-08-16T07:23:50.865ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76642024-08-16T07:23:50.865ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
76652024-08-16T07:23:50.865ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
76662024-08-16T07:23:50.865ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
76672024-08-16T07:23:50.865ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
76682024-08-16T07:23:50.865ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
76692024-08-16T07:23:50.865ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76702024-08-16T07:23:50.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
76712024-08-16T07:23:50.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76722024-08-16T07:23:50.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
76732024-08-16T07:23:50.866ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76742024-08-16T07:23:50.866ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
76752024-08-16T07:23:50.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
76762024-08-16T07:23:50.866ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
76772024-08-16T07:23:50.866ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
76782024-08-16T07:23:50.866ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
76792024-08-16T07:23:50.866ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
76802024-08-16T07:23:50.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
76812024-08-16T07:23:50.867ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76822024-08-16T07:23:50.867ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
76832024-08-16T07:23:50.867ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76842024-08-16T07:23:50.867ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
76852024-08-16T07:23:50.867ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
76862024-08-16T07:23:50.867ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
76872024-08-16T07:23:50.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76882024-08-16T07:23:50.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
76892024-08-16T07:23:50.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
76902024-08-16T07:23:50.867ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
76912024-08-16T07:23:50.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
76922024-08-16T07:23:50.867ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76932024-08-16T07:23:50.868ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76942024-08-16T07:23:50.868ZWARNnexus (BackgroundTasks): region replacement task done background_task = region_replacement file = nexus/src/app/background/tasks/region_replacement.rs:185
76952024-08-16T07:23:50.868ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 6.93754ms iteration = 15 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
76962024-08-16T07:23:50.868ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76972024-08-16T07:23:50.868ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1494, tv_nsec: 245696447 } })
76982024-08-16T07:23:50.869ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
76992024-08-16T07:23:50.869ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
77002024-08-16T07:23:50.869ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
77012024-08-16T07:23:50.869ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77022024-08-16T07:23:50.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
77032024-08-16T07:23:50.869ZINFOnexus (BackgroundTasks): region snapshot replacement start task done background_task = region_snapshot_replacement_start file = nexus/src/app/background/tasks/region_snapshot_replacement_start.rs:252
77042024-08-16T07:23:50.869ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 8.319233ms iteration = 15 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
77052024-08-16T07:23:50.870ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
77062024-08-16T07:23:50.870ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
77072024-08-16T07:23:50.870ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
77082024-08-16T07:23:50.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
77092024-08-16T07:23:50.871ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
77102024-08-16T07:23:50.871ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
77112024-08-16T07:23:50.871ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
77122024-08-16T07:23:50.871ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77132024-08-16T07:23:50.871ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
77142024-08-16T07:23:50.871ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
77152024-08-16T07:23:50.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
77162024-08-16T07:23:50.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77172024-08-16T07:23:50.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
77182024-08-16T07:23:50.872ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
77192024-08-16T07:23:50.872ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
77202024-08-16T07:23:50.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
77212024-08-16T07:23:50.873ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
77222024-08-16T07:23:50.873ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
77232024-08-16T07:23:50.873ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
77242024-08-16T07:23:50.873ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
77252024-08-16T07:23:50.873ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
77262024-08-16T07:23:50.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
77272024-08-16T07:23:50.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
77282024-08-16T07:23:50.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
77292024-08-16T07:23:50.874ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
77302024-08-16T07:23:50.874ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
77312024-08-16T07:23:50.874ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 12.906068ms iteration = 8 status = {"error":null,"error_count":0,"found":0,"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0}
77322024-08-16T07:23:50.874ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
77332024-08-16T07:23:50.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
77342024-08-16T07:23:50.875ZWARNnexus (BackgroundTasks): physical disk adoption task done background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:174
77352024-08-16T07:23:50.875ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 19.610783ms iteration = 17 status = {"physical_disks_added":0}
77362024-08-16T07:23:50.875ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
77372024-08-16T07:23:50.875ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 2c55b660-f328-498e-b44c-73da75015ed4 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
77382024-08-16T07:23:50.875ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
77392024-08-16T07:23:50.875ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77402024-08-16T07:23:50.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
77412024-08-16T07:23:50.876ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77422024-08-16T07:23:50.877ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
77432024-08-16T07:23:50.877ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = ddebb22e-3faa-4936-9b3e-0f4d28827c0e dns_zone_name = oxide.test found_so_far = 0 version = 2
77442024-08-16T07:23:50.877ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
77452024-08-16T07:23:50.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
77462024-08-16T07:23:50.877ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
77472024-08-16T07:23:50.877ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
77482024-08-16T07:23:50.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
77492024-08-16T07:23:50.878ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77502024-08-16T07:23:50.879ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
77512024-08-16T07:23:50.879ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.36067ms iteration = 43 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
77522024-08-16T07:23:50.880ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
77532024-08-16T07:23:50.880ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
77542024-08-16T07:23:50.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
77552024-08-16T07:23:50.881ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
77562024-08-16T07:23:50.881ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
77572024-08-16T07:23:50.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
77582024-08-16T07:23:50.882ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = ddebb22e-3faa-4936-9b3e-0f4d28827c0e dns_zone_name = oxide.test found_so_far = 1 version = 2
77592024-08-16T07:23:50.882ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
77602024-08-16T07:23:50.882ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-08-16 07:16:55.724690 UTC dns_group = external generation = 2
77612024-08-16T07:23:50.882ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 26.745158ms iteration = 8 status = {"generation":2}
77622024-08-16T07:23:50.882ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 2c55b660-f328-498e-b44c-73da75015ed4 dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
77632024-08-16T07:23:50.882ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
77642024-08-16T07:23:50.882ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-08-16 07:16:55.302318 UTC dns_group = internal generation = 1
77652024-08-16T07:23:50.882ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 26.886581ms iteration = 8 status = {"generation":1}
77662024-08-16T07:23:50.882ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
77672024-08-16T07:23:50.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
77682024-08-16T07:23:50.895ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
77692024-08-16T07:23:50.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
77702024-08-16T07:23:50.897ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
77712024-08-16T07:23:50.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
77722024-08-16T07:23:50.897ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
77732024-08-16T07:23:50.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
77742024-08-16T07:23:50.898ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77752024-08-16T07:23:50.899ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77762024-08-16T07:23:50.901ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
77772024-08-16T07:23:50.901ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
77782024-08-16T07:23:50.901ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae, lookup_type: ById(03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae) } result = Ok(())
77792024-08-16T07:23:50.901ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
77802024-08-16T07:23:50.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
77812024-08-16T07:23:50.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
77822024-08-16T07:23:50.902ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77832024-08-16T07:23:50.903ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 41.912228ms iteration = 15 status = 0
77842024-08-16T07:23:50.904ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
77852024-08-16T07:23:50.904ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
77862024-08-16T07:23:50.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
77872024-08-16T07:23:50.910ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
77882024-08-16T07:23:50.910ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
77892024-08-16T07:23:50.910ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 49.526744ms iteration = 15 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
77902024-08-16T07:23:50.935ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-08-16T07:16:49.943339Z, time_modified: 2024-08-16T07:16:49.943339Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, db_silo: Silo { identity: SiloIdentity { id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-16T07:16:55.682566Z, time_modified: 2024-08-16T07:16:55.682566Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "c9e400628d2b58a74b998fbfa44a053952e83a6e8d3c49e6518981bf7d4a006f" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, db_silo: Silo { identity: SiloIdentity { id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-16T07:16:55.682566Z, time_modified: 2024-08-16T07:16:55.682566Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "c9e400628d2b58a74b998fbfa44a053952e83a6e8d3c49e6518981bf7d4a006f" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
77912024-08-16T07:23:50.935ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 79.318162ms iteration = 8 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071","tls_certs":["c9e400628d2b58a74b998fbfa44a053952e83a6e8d3c49e6518981bf7d4a006f"]}},"default_endpoint":{"silo_id":"439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071","tls_certs":["c9e400628d2b58a74b998fbfa44a053952e83a6e8d3c49e6518981bf7d4a006f"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
77922024-08-16T07:23:51.092ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a zone_address = fd00:1122:3344:101::2
77932024-08-16T07:23:51.092ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
77942024-08-16T07:23:51.092ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "cefe436c-73db-494a-baf0-c5744a695edf", "content-length": "26", "date": "Fri, 16 Aug 2024 07:23:51 GMT"} })
77952024-08-16T07:23:51.092ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
77962024-08-16T07:23:51.094ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
77972024-08-16T07:23:51.114ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
77982024-08-16T07:23:51.121ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
77992024-08-16T07:23:51.128ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
78002024-08-16T07:23:51.129ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "5ff0a28e-64f7-4059-aac6-4822fc0ee042", "content-length": "809", "date": "Fri, 16 Aug 2024 07:23:51 GMT"} })
78012024-08-16T07:23:51.129ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {VirtualNetworkInterfaceHost { physical_host_ip: fd00:1122:3344:101::1, virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 250, 109, 178])), vni: Vni(941973) }} sled = sock
78022024-08-16T07:23:51.129ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
78032024-08-16T07:23:51.129ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
78042024-08-16T07:23:51.130ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 269.448583ms iteration = 15 status = {}
78052024-08-16T07:23:51.148ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
78062024-08-16T07:23:51.148ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
78072024-08-16T07:23:51.148ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "cd6ba86f-61dc-42ae-804f-1167068d2486", "content-length": "26", "date": "Fri, 16 Aug 2024 07:23:51 GMT"} })
78082024-08-16T07:23:51.148ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
78092024-08-16T07:23:51.150ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
78102024-08-16T07:23:51.154ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = instance_watcher body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/instances/1a5c861f-b142-4554-9da6-cdc902ef7a3f/state
78112024-08-16T07:23:51.154ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = instance_watcher result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/instances/1a5c861f-b142-4554-9da6-cdc902ef7a3f/state", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "5acc1584-67ce-4ec9-94f1-52601ae338d4", "content-length": "183", "date": "Fri, 16 Aug 2024 07:23:51 GMT"} })
78122024-08-16T07:23:51.156ZDEBGnexus (BackgroundTasks): updating instance state background_task = instance_watcher instance_id = 1a5c861f-b142-4554-9da6-cdc902ef7a3f state = Running
78132024-08-16T07:23:51.156ZINFOnexus (BackgroundTasks): received new VMM runtime state from sled agent background_task = instance_watcher file = nexus/src/app/instance.rs:1846 instance_id = 1a5c861f-b142-4554-9da6-cdc902ef7a3f migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 0cf6e496-975f-45c7-be02-aad19df20905 vmm_state = VmmRuntimeState { state: Running, gen: Generation(3), time_updated: 2024-08-16T07:23:47.235929007Z }
78142024-08-16T07:23:51.156ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher instance_id = 1a5c861f-b142-4554-9da6-cdc902ef7a3f roles = RoleSet { roles: {} }
78152024-08-16T07:23:51.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher instance_id = 1a5c861f-b142-4554-9da6-cdc902ef7a3f resource = Database result = Ok(())
78162024-08-16T07:23:51.163ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 1 total_failed = 0 total_incomplete = 0 total_instances = 1 update_sagas_queued = 0
78172024-08-16T07:23:51.163ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 302.573488ms iteration = 15 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{"running":1},"pruned_instances":0,"total_instances":1,"update_sagas_queued":0}
78182024-08-16T07:23:51.171ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
78192024-08-16T07:23:51.171ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
78202024-08-16T07:23:51.171ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "23843068-c181-4609-aeb0-cfecc55a759b", "content-length": "26", "date": "Fri, 16 Aug 2024 07:23:51 GMT"} })
78212024-08-16T07:23:51.171ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
78222024-08-16T07:23:51.173ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
78232024-08-16T07:23:51.206ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
78242024-08-16T07:23:51.206ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e1ffdf5d-1941-4a7e-b623-fc6929616003", "content-length": "521", "date": "Fri, 16 Aug 2024 07:23:51 GMT"} })
78252024-08-16T07:23:51.206ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78262024-08-16T07:23:51.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78272024-08-16T07:23:51.208ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
78282024-08-16T07:23:51.208ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 346.736148ms iteration = 43 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
78292024-08-16T07:23:51.209ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78302024-08-16T07:23:51.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78312024-08-16T07:23:51.212ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78322024-08-16T07:23:51.212ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78332024-08-16T07:23:51.214ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78342024-08-16T07:23:51.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78352024-08-16T07:23:51.216ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78362024-08-16T07:23:51.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78372024-08-16T07:23:51.219ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78382024-08-16T07:23:51.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78392024-08-16T07:23:51.221ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78402024-08-16T07:23:51.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78412024-08-16T07:23:51.223ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78422024-08-16T07:23:51.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78432024-08-16T07:23:51.225ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78442024-08-16T07:23:51.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78452024-08-16T07:23:51.226ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78462024-08-16T07:23:51.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78472024-08-16T07:23:51.228ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78482024-08-16T07:23:51.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78492024-08-16T07:23:51.229ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78502024-08-16T07:23:51.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78512024-08-16T07:23:51.230ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78522024-08-16T07:23:51.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78532024-08-16T07:23:51.231ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78542024-08-16T07:23:51.235ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, lookup_type: ById(439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071) }, key: dcc6705f-5b5d-4019-b465-b7f78edf8c56, lookup_type: ById(dcc6705f-5b5d-4019-b465-b7f78edf8c56) }, key: 8ac28316-0d8b-4dc0-92d2-03ea907c8c07, lookup_type: ById(8ac28316-0d8b-4dc0-92d2-03ea907c8c07) }, key: 93d0eb99-66cc-4643-ba01-488ed248dc49, lookup_type: ById(93d0eb99-66cc-4643-ba01-488ed248dc49) } result = Ok(())
78552024-08-16T07:23:51.235ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78562024-08-16T07:23:51.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78572024-08-16T07:23:51.236ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78582024-08-16T07:23:51.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78592024-08-16T07:23:51.237ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78602024-08-16T07:23:51.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78612024-08-16T07:23:51.238ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78622024-08-16T07:23:51.242ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, lookup_type: ById(439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071) }, key: dcc6705f-5b5d-4019-b465-b7f78edf8c56, lookup_type: ById(dcc6705f-5b5d-4019-b465-b7f78edf8c56) }, key: 8ac28316-0d8b-4dc0-92d2-03ea907c8c07, lookup_type: ById(8ac28316-0d8b-4dc0-92d2-03ea907c8c07) }, key: 93d0eb99-66cc-4643-ba01-488ed248dc49, lookup_type: ById(93d0eb99-66cc-4643-ba01-488ed248dc49) } result = Ok(())
78632024-08-16T07:23:51.242ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78642024-08-16T07:23:51.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78652024-08-16T07:23:51.256ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78662024-08-16T07:23:51.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78672024-08-16T07:23:51.258ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78682024-08-16T07:23:51.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78692024-08-16T07:23:51.260ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78702024-08-16T07:23:51.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78712024-08-16T07:23:51.261ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78722024-08-16T07:23:51.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78732024-08-16T07:23:51.270ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78742024-08-16T07:23:51.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78752024-08-16T07:23:51.271ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78762024-08-16T07:23:51.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78772024-08-16T07:23:51.273ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78782024-08-16T07:23:51.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78792024-08-16T07:23:51.274ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78802024-08-16T07:23:51.280ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, lookup_type: ById(439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071) }, key: dcc6705f-5b5d-4019-b465-b7f78edf8c56, lookup_type: ById(dcc6705f-5b5d-4019-b465-b7f78edf8c56) }, key: 8ac28316-0d8b-4dc0-92d2-03ea907c8c07, lookup_type: ById(8ac28316-0d8b-4dc0-92d2-03ea907c8c07) }, key: aef28211-c0d7-4946-965a-1839841c64c4, lookup_type: ByName("default") } result = Ok(())
78812024-08-16T07:23:51.289ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
78822024-08-16T07:23:51.289ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "e19d8cfb-9a0d-4e35-9ac8-4af141e89245", "date": "Fri, 16 Aug 2024 07:23:51 GMT"} })
78832024-08-16T07:23:51.291ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 430.149744ms iteration = 15 status = {}
78842024-08-16T07:23:51.302ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
78852024-08-16T07:23:51.302ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "e1681054-20fd-4d28-8790-d1d5144f5a2d", "date": "Fri, 16 Aug 2024 07:23:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
78862024-08-16T07:23:51.302ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
78872024-08-16T07:23:51.304ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "ba66b1fd-57bf-4fc7-9f4c-a949284cb37a", "date": "Fri, 16 Aug 2024 07:23:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
78882024-08-16T07:23:51.304ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
78892024-08-16T07:23:51.305ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
78902024-08-16T07:23:51.305ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 444.354493ms iteration = 10 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
78912024-08-16T07:23:51.332ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 476.238919ms iteration = 15 status = {}
78922024-08-16T07:23:51.465ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
78932024-08-16T07:23:51.490ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
78942024-08-16T07:23:51.490ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "8a15fe05-985f-4408-a4d6-378ddf6a1db5", "content-length": "1", "date": "Fri, 16 Aug 2024 07:23:51 GMT"} })
78952024-08-16T07:23:51.492ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
78962024-08-16T07:23:51.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
78972024-08-16T07:23:51.493ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 637.975824ms iteration = 15 status = null
78982024-08-16T07:23:51.605ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
78992024-08-16T07:23:51.607ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "ac56bc84-7671-4fe9-8dc7-98155fa3c26a", "date": "Fri, 16 Aug 2024 07:23:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
79002024-08-16T07:23:51.607ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
79012024-08-16T07:23:51.609ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "96d30966-b548-4716-9523-ed59ddb2c516", "date": "Fri, 16 Aug 2024 07:23:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
79022024-08-16T07:23:51.609ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
79032024-08-16T07:23:51.611ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "e41dc2c6-93d8-4eca-8ea1-2bee2edeed5b", "date": "Fri, 16 Aug 2024 07:23:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
79042024-08-16T07:23:51.611ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
79052024-08-16T07:23:51.613ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
79062024-08-16T07:23:51.613ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 757.914744ms iteration = 10 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
79072024-08-16T07:23:51.618ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = b8df9778-c93b-40d4-a0b7-dd2148461df7 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
79082024-08-16T07:23:51.619ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = b8df9778-c93b-40d4-a0b7-dd2148461df7 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
79092024-08-16T07:23:51.620ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1911 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = b8df9778-c93b-40d4-a0b7-dd2148461df7 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
79102024-08-16T07:23:51.637ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79112024-08-16T07:23:51.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79122024-08-16T07:23:51.638ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:146 port = SwitchPort { id: f13c0939-2c9d-4a0d-b006-5f3de89cc4fc, rack_id: e1b0d583-7b20-4a4b-97f9-9f83300aeb7a, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(4de7fcf8-2b1f-4b0e-ba6f-584e8a34addb) } rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0
79132024-08-16T07:23:51.638ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79142024-08-16T07:23:51.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79152024-08-16T07:23:51.647ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
79162024-08-16T07:23:51.648ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "29be06ab-1898-433a-9f2f-4fb17bf5c77c", "content-length": "121", "date": "Fri, 16 Aug 2024 07:23:51 GMT"} })
79172024-08-16T07:23:51.648ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1663 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
79182024-08-16T07:23:51.648ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1690 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 4de7fcf8-2b1f-4b0e-ba6f-584e8a34addb
79192024-08-16T07:23:51.648ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None)}}
79202024-08-16T07:23:51.648ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None)}}
79212024-08-16T07:23:51.648ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {}
79222024-08-16T07:23:51.648ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {}
79232024-08-16T07:23:51.648ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
79242024-08-16T07:23:51.648ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79252024-08-16T07:23:51.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79262024-08-16T07:23:51.650ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
79272024-08-16T07:23:51.650ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "0114b324-00fc-46d8-a92a-b41c445c63ec", "content-length": "2", "date": "Fri, 16 Aug 2024 07:23:51 GMT"} })
79282024-08-16T07:23:51.650ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
79292024-08-16T07:23:51.651ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "7921eb32-664e-4496-9ac2-47f5593849b4", "content-length": "52", "date": "Fri, 16 Aug 2024 07:23:51 GMT"} })
79302024-08-16T07:23:51.651ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0
79312024-08-16T07:23:51.651ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
79322024-08-16T07:23:51.679ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 872 local_addr = [fd00:1122:3344:101::c]:53719 method = GET remote_addr = [fd00:1122:3344:101::d]:60737 req_id = 8220c454-b9b7-4ef7-89af-7a08ddf0161b response_code = 200 uri = /0d900881-9285-4dbf-910f-5e4676c8f133
79332024-08-16T07:23:51.703ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "3b86a99b-78d2-4c2f-b154-33ff564780c6", "date": "Fri, 16 Aug 2024 07:23:51 GMT"} })
79342024-08-16T07:23:51.703ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch = Switch0
79352024-08-16T07:23:51.703ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
79362024-08-16T07:23:51.705ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "4bf63384-2869-4713-955c-ed189762294b", "content-length": "494", "date": "Fri, 16 Aug 2024 07:23:51 GMT"} })
79372024-08-16T07:23:51.705ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79382024-08-16T07:23:51.705ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79392024-08-16T07:23:51.707ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79402024-08-16T07:23:51.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79412024-08-16T07:23:51.710ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79422024-08-16T07:23:51.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79432024-08-16T07:23:51.712ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79442024-08-16T07:23:51.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79452024-08-16T07:23:51.719ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 858.402815ms iteration = 15 status = {}
79462024-08-16T07:23:52.642ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 644758b7-ac2e-448c-acf1-a4f7f62f3a6a roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
79472024-08-16T07:23:52.642ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 644758b7-ac2e-448c-acf1-a4f7f62f3a6a resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
79482024-08-16T07:23:52.645ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2638 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 644758b7-ac2e-448c-acf1-a4f7f62f3a6a response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
79492024-08-16T07:23:53.664ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 652eb250-7864-458f-af65-8fbfb8d367ae roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
79502024-08-16T07:23:53.664ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 652eb250-7864-458f-af65-8fbfb8d367ae resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
79512024-08-16T07:23:53.666ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2301 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 652eb250-7864-458f-af65-8fbfb8d367ae response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
79522024-08-16T07:23:54.686ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 4a22240e-80d3-484e-9f0a-17d2c76a3be8 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
79532024-08-16T07:23:54.686ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 4a22240e-80d3-484e-9f0a-17d2c76a3be8 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
79542024-08-16T07:23:54.688ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2107 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 4a22240e-80d3-484e-9f0a-17d2c76a3be8 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
79552024-08-16T07:23:55.706ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = c3fdb38d-01db-4b28-9297-1d1c8165866b roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
79562024-08-16T07:23:55.706ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = c3fdb38d-01db-4b28-9297-1d1c8165866b resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
79572024-08-16T07:23:55.708ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1530 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = c3fdb38d-01db-4b28-9297-1d1c8165866b response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
79582024-08-16T07:23:56.728ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 20634c40-adf3-4725-be2f-2b2a42f7f95b roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
79592024-08-16T07:23:56.728ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 20634c40-adf3-4725-be2f-2b2a42f7f95b resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
79602024-08-16T07:23:56.730ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2601 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 20634c40-adf3-4725-be2f-2b2a42f7f95b response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
79612024-08-16T07:23:57.207ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1846 instance_id = 1a5c861f-b142-4554-9da6-cdc902ef7a3f local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 0cf6e496-975f-45c7-be02-aad19df20905 remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 6c874e5e-9922-4771-bedc-3704a94bb095 uri = /instances/1a5c861f-b142-4554-9da6-cdc902ef7a3f vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(5), time_updated: 2024-08-16T07:23:57.206855584Z }
79622024-08-16T07:23:57.207ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 6c874e5e-9922-4771-bedc-3704a94bb095 roles = RoleSet { roles: {} } uri = /instances/1a5c861f-b142-4554-9da6-cdc902ef7a3f
79632024-08-16T07:23:57.207ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 6c874e5e-9922-4771-bedc-3704a94bb095 resource = Database result = Ok(()) uri = /instances/1a5c861f-b142-4554-9da6-cdc902ef7a3f
79642024-08-16T07:23:57.219ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 12176 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 6c874e5e-9922-4771-bedc-3704a94bb095 response_code = 204 uri = /instances/1a5c861f-b142-4554-9da6-cdc902ef7a3f
79652024-08-16T07:23:57.749ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 733adbf0-c66f-4a95-a412-c6dd4b5f5c2e roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
79662024-08-16T07:23:57.750ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 733adbf0-c66f-4a95-a412-c6dd4b5f5c2e resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
79672024-08-16T07:23:57.751ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2523 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 733adbf0-c66f-4a95-a412-c6dd4b5f5c2e response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
79682024-08-16T07:23:58.113ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64556 req_id = 713d1875-d2b0-4f90-b53d-fbab468f939f roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
79692024-08-16T07:23:58.113ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64556 req_id = 713d1875-d2b0-4f90-b53d-fbab468f939f resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
79702024-08-16T07:23:58.115ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2588 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64556 req_id = 713d1875-d2b0-4f90-b53d-fbab468f939f response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
79712024-08-16T07:23:58.116ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64556 req_id = 2031716b-6c59-4d8d-a74a-11eab3b4fe68 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
79722024-08-16T07:23:58.117ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64556 req_id = 2031716b-6c59-4d8d-a74a-11eab3b4fe68 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
79732024-08-16T07:23:58.119ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 3219 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64556 req_id = 2031716b-6c59-4d8d-a74a-11eab3b4fe68 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
79742024-08-16T07:23:58.773ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = f4df609c-79f9-4db5-aa14-416505d3320e roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
79752024-08-16T07:23:58.773ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = f4df609c-79f9-4db5-aa14-416505d3320e resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
79762024-08-16T07:23:58.774ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1705 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = f4df609c-79f9-4db5-aa14-416505d3320e response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
79772024-08-16T07:23:59.121ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64556 req_id = e3aad523-317a-4064-bb56-36267b1a4b39 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
79782024-08-16T07:23:59.121ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64556 req_id = e3aad523-317a-4064-bb56-36267b1a4b39 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
79792024-08-16T07:23:59.123ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 3037 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64556 req_id = e3aad523-317a-4064-bb56-36267b1a4b39 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
79802024-08-16T07:23:59.599ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1846 instance_id = 1a5c861f-b142-4554-9da6-cdc902ef7a3f local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 0cf6e496-975f-45c7-be02-aad19df20905 remote_addr = [fd00:1122:3344:101::1]:48494 req_id = a62e10ff-6b78-44c2-9b49-9826139258be uri = /instances/1a5c861f-b142-4554-9da6-cdc902ef7a3f vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-08-16T07:23:59.598952389Z }
79812024-08-16T07:23:59.600ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:48494 req_id = a62e10ff-6b78-44c2-9b49-9826139258be roles = RoleSet { roles: {} } uri = /instances/1a5c861f-b142-4554-9da6-cdc902ef7a3f
79822024-08-16T07:23:59.600ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:48494 req_id = a62e10ff-6b78-44c2-9b49-9826139258be resource = Database result = Ok(()) uri = /instances/1a5c861f-b142-4554-9da6-cdc902ef7a3f
79832024-08-16T07:23:59.633ZDEBGnexus (dropshot_internal): new VMM runtime state from sled agent requires an instance-update saga actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 1a5c861f-b142-4554-9da6-cdc902ef7a3f local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_in_needs_update = false migration_out_needs_update = false propolis_id = 0cf6e496-975f-45c7-be02-aad19df20905 remote_addr = [fd00:1122:3344:101::1]:48494 req_id = a62e10ff-6b78-44c2-9b49-9826139258be uri = /instances/1a5c861f-b142-4554-9da6-cdc902ef7a3f vmm_needs_update = true
79842024-08-16T07:23:59.633ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:48494 req_id = a62e10ff-6b78-44c2-9b49-9826139258be roles = RoleSet { roles: {} } uri = /instances/1a5c861f-b142-4554-9da6-cdc902ef7a3f
79852024-08-16T07:23:59.634ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:48494 req_id = a62e10ff-6b78-44c2-9b49-9826139258be resource = Database result = Ok(()) uri = /instances/1a5c861f-b142-4554-9da6-cdc902ef7a3f
79862024-08-16T07:23:59.641ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:48494 req_id = a62e10ff-6b78-44c2-9b49-9826139258be roles = RoleSet { roles: {} } uri = /instances/1a5c861f-b142-4554-9da6-cdc902ef7a3f
79872024-08-16T07:23:59.641ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:48494 req_id = a62e10ff-6b78-44c2-9b49-9826139258be resource = Database result = Ok(()) uri = /instances/1a5c861f-b142-4554-9da6-cdc902ef7a3f
79882024-08-16T07:23:59.642ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:48494 req_id = a62e10ff-6b78-44c2-9b49-9826139258be roles = RoleSet { roles: {} } uri = /instances/1a5c861f-b142-4554-9da6-cdc902ef7a3f
79892024-08-16T07:23:59.642ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:48494 req_id = a62e10ff-6b78-44c2-9b49-9826139258be resource = Database result = Ok(()) uri = /instances/1a5c861f-b142-4554-9da6-cdc902ef7a3f
79902024-08-16T07:23:59.643ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:48494 req_id = a62e10ff-6b78-44c2-9b49-9826139258be roles = RoleSet { roles: {} } uri = /instances/1a5c861f-b142-4554-9da6-cdc902ef7a3f
79912024-08-16T07:23:59.644ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:48494 req_id = a62e10ff-6b78-44c2-9b49-9826139258be resource = Database result = Ok(()) uri = /instances/1a5c861f-b142-4554-9da6-cdc902ef7a3f
79922024-08-16T07:23:59.644ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:48494 req_id = a62e10ff-6b78-44c2-9b49-9826139258be roles = RoleSet { roles: {} } uri = /instances/1a5c861f-b142-4554-9da6-cdc902ef7a3f
79932024-08-16T07:23:59.645ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:48494 req_id = a62e10ff-6b78-44c2-9b49-9826139258be resource = Database result = Ok(()) uri = /instances/1a5c861f-b142-4554-9da6-cdc902ef7a3f
79942024-08-16T07:23:59.646ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:48494 req_id = a62e10ff-6b78-44c2-9b49-9826139258be roles = RoleSet { roles: {} } uri = /instances/1a5c861f-b142-4554-9da6-cdc902ef7a3f
79952024-08-16T07:23:59.646ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:48494 req_id = a62e10ff-6b78-44c2-9b49-9826139258be resource = Database result = Ok(()) uri = /instances/1a5c861f-b142-4554-9da6-cdc902ef7a3f
79962024-08-16T07:23:59.647ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:48494 req_id = a62e10ff-6b78-44c2-9b49-9826139258be roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /instances/1a5c861f-b142-4554-9da6-cdc902ef7a3f
79972024-08-16T07:23:59.649ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:48494 req_id = a62e10ff-6b78-44c2-9b49-9826139258be resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, lookup_type: ById(439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071) }, key: dcc6705f-5b5d-4019-b465-b7f78edf8c56, lookup_type: ById(dcc6705f-5b5d-4019-b465-b7f78edf8c56) }, key: 1a5c861f-b142-4554-9da6-cdc902ef7a3f, lookup_type: ById(1a5c861f-b142-4554-9da6-cdc902ef7a3f) } result = Ok(()) uri = /instances/1a5c861f-b142-4554-9da6-cdc902ef7a3f
79982024-08-16T07:23:59.656ZINFOnexus (dropshot_internal): starting update saga for 1a5c861f-b142-4554-9da6-cdc902ef7a3f actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1348 instance_id = 1a5c861f-b142-4554-9da6-cdc902ef7a3f local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } remote_addr = [fd00:1122:3344:101::1]:48494 req_id = a62e10ff-6b78-44c2-9b49-9826139258be uri = /instances/1a5c861f-b142-4554-9da6-cdc902ef7a3f vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-08-16T07:23:59.598952389Z }
79992024-08-16T07:23:59.656ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 57464 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:48494 req_id = a62e10ff-6b78-44c2-9b49-9826139258be response_code = 204 uri = /instances/1a5c861f-b142-4554-9da6-cdc902ef7a3f
80002024-08-16T07:23:59.657ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1846 instance_id = 1a5c861f-b142-4554-9da6-cdc902ef7a3f local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 0cf6e496-975f-45c7-be02-aad19df20905 remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 59709e83-fa41-445d-a885-1a407aebe375 uri = /instances/1a5c861f-b142-4554-9da6-cdc902ef7a3f vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-08-16T07:23:59.598952389Z }
80012024-08-16T07:23:59.657ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 59709e83-fa41-445d-a885-1a407aebe375 roles = RoleSet { roles: {} } uri = /instances/1a5c861f-b142-4554-9da6-cdc902ef7a3f
80022024-08-16T07:23:59.657ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 59709e83-fa41-445d-a885-1a407aebe375 resource = Database result = Ok(()) uri = /instances/1a5c861f-b142-4554-9da6-cdc902ef7a3f
80032024-08-16T07:23:59.659ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:212 saga_id = ad8b8f45-9ad9-4a38-8661-90e653522be1 saga_name = start-instance-update
80042024-08-16T07:23:59.659ZINFOnexus (SEC): saga create dag = {"end_node":4,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,0,null],[2,4,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"start_instance_update.lock_instance","label":"LockInstance","name":"updater_lock"}},{"Action":{"action_name":"start_instance_update.fetch_state_and_start_real_saga","label":"FetchStateAndStartRealSaga","name":"state"}},{"Start":{"params":{"authz_instance":{"key":"1a5c861f-b142-4554-9da6-cdc902ef7a3f","lookup_type":{"ById":"1a5c861f-b142-4554-9da6-cdc902ef7a3f"},"parent":{"key":"dcc6705f-5b5d-4019-b465-b7f78edf8c56","lookup_type":{"ById":"dcc6705f-5b5d-4019-b465-b7f78edf8c56"},"parent":{"key":"439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071","lookup_type":{"ById":"439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071"},"parent":null}}},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}}}}},"End"]},"saga_name":"start-instance-update","start_node":3} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = ad8b8f45-9ad9-4a38-8661-90e653522be1 saga_name = start-instance-update sec_id = 0d900881-9285-4dbf-910f-5e4676c8f133
80052024-08-16T07:23:59.661ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = ad8b8f45-9ad9-4a38-8661-90e653522be1 saga_name = start-instance-update
80062024-08-16T07:23:59.685ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 28423 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 59709e83-fa41-445d-a885-1a407aebe375 response_code = 204 uri = /instances/1a5c861f-b142-4554-9da6-cdc902ef7a3f
80072024-08-16T07:23:59.695ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:310 saga_id = ad8b8f45-9ad9-4a38-8661-90e653522be1 saga_name = start-instance-update
80082024-08-16T07:23:59.695ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = ad8b8f45-9ad9-4a38-8661-90e653522be1 saga_name = start-instance-update sec_id = 0d900881-9285-4dbf-910f-5e4676c8f133
80092024-08-16T07:23:59.695ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 0d900881-9285-4dbf-910f-5e4676c8f133
80102024-08-16T07:23:59.695ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = ad8b8f45-9ad9-4a38-8661-90e653522be1
80112024-08-16T07:23:59.705ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 0d900881-9285-4dbf-910f-5e4676c8f133
80122024-08-16T07:23:59.705ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = ad8b8f45-9ad9-4a38-8661-90e653522be1
80132024-08-16T07:23:59.714ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 0d900881-9285-4dbf-910f-5e4676c8f133
80142024-08-16T07:23:59.714ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = ad8b8f45-9ad9-4a38-8661-90e653522be1
80152024-08-16T07:23:59.727ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 0d900881-9285-4dbf-910f-5e4676c8f133
80162024-08-16T07:23:59.727ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("127fbdd9-695a-4e8c-91a9-d4befaede45f")) node_id = 0 saga_id = ad8b8f45-9ad9-4a38-8661-90e653522be1
80172024-08-16T07:23:59.731ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 0d900881-9285-4dbf-910f-5e4676c8f133
80182024-08-16T07:23:59.731ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = ad8b8f45-9ad9-4a38-8661-90e653522be1
80192024-08-16T07:23:59.742ZINFOnexus (SagaExecutor): instance update: attempting to lock instance file = nexus/src/app/sagas/instance_update/start.rs:93 instance_id = 1a5c861f-b142-4554-9da6-cdc902ef7a3f saga_id = ad8b8f45-9ad9-4a38-8661-90e653522be1 saga_name = start-instance-update
80202024-08-16T07:23:59.742ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ad8b8f45-9ad9-4a38-8661-90e653522be1 saga_name = start-instance-update saga_node = LockInstance
80212024-08-16T07:23:59.742ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ad8b8f45-9ad9-4a38-8661-90e653522be1 saga_name = start-instance-update saga_node = LockInstance
80222024-08-16T07:23:59.744ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ad8b8f45-9ad9-4a38-8661-90e653522be1 saga_name = start-instance-update saga_node = LockInstance
80232024-08-16T07:23:59.744ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ad8b8f45-9ad9-4a38-8661-90e653522be1 saga_name = start-instance-update saga_node = LockInstance
80242024-08-16T07:23:59.745ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ad8b8f45-9ad9-4a38-8661-90e653522be1 saga_name = start-instance-update saga_node = LockInstance
80252024-08-16T07:23:59.745ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ad8b8f45-9ad9-4a38-8661-90e653522be1 saga_name = start-instance-update saga_node = LockInstance
80262024-08-16T07:23:59.746ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ad8b8f45-9ad9-4a38-8661-90e653522be1 saga_name = start-instance-update saga_node = LockInstance
80272024-08-16T07:23:59.746ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ad8b8f45-9ad9-4a38-8661-90e653522be1 saga_name = start-instance-update saga_node = LockInstance
80282024-08-16T07:23:59.747ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ad8b8f45-9ad9-4a38-8661-90e653522be1 saga_name = start-instance-update saga_node = LockInstance
80292024-08-16T07:23:59.747ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ad8b8f45-9ad9-4a38-8661-90e653522be1 saga_name = start-instance-update saga_node = LockInstance
80302024-08-16T07:23:59.748ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ad8b8f45-9ad9-4a38-8661-90e653522be1 saga_name = start-instance-update saga_node = LockInstance
80312024-08-16T07:23:59.748ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ad8b8f45-9ad9-4a38-8661-90e653522be1 saga_name = start-instance-update saga_node = LockInstance
80322024-08-16T07:23:59.749ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = ad8b8f45-9ad9-4a38-8661-90e653522be1 saga_name = start-instance-update saga_node = LockInstance
80332024-08-16T07:23:59.752ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, lookup_type: ById(439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071) }, key: dcc6705f-5b5d-4019-b465-b7f78edf8c56, lookup_type: ById(dcc6705f-5b5d-4019-b465-b7f78edf8c56) }, key: 1a5c861f-b142-4554-9da6-cdc902ef7a3f, lookup_type: ById(1a5c861f-b142-4554-9da6-cdc902ef7a3f) } result = Ok(()) saga_id = ad8b8f45-9ad9-4a38-8661-90e653522be1 saga_name = start-instance-update saga_node = LockInstance
80342024-08-16T07:23:59.754ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 1a5c861f-b142-4554-9da6-cdc902ef7a3f saga_id = ad8b8f45-9ad9-4a38-8661-90e653522be1 saga_name = start-instance-update saga_node = LockInstance updater_id = 127fbdd9-695a-4e8c-91a9-d4befaede45f
80352024-08-16T07:23:59.754ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ad8b8f45-9ad9-4a38-8661-90e653522be1 saga_name = start-instance-update saga_node = LockInstance
80362024-08-16T07:23:59.755ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ad8b8f45-9ad9-4a38-8661-90e653522be1 saga_name = start-instance-update saga_node = LockInstance
80372024-08-16T07:23:59.766ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 1a5c861f-b142-4554-9da6-cdc902ef7a3f saga_id = ad8b8f45-9ad9-4a38-8661-90e653522be1 saga_name = start-instance-update saga_node = LockInstance updater_id = 127fbdd9-695a-4e8c-91a9-d4befaede45f
80382024-08-16T07:23:59.766ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ad8b8f45-9ad9-4a38-8661-90e653522be1 saga_name = start-instance-update saga_node = LockInstance
80392024-08-16T07:23:59.766ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ad8b8f45-9ad9-4a38-8661-90e653522be1 saga_name = start-instance-update saga_node = LockInstance
80402024-08-16T07:23:59.768ZDEBGnexus (SagaExecutor): instance updater lock acquired! actor_id = 001de000-05e4-4000-8000-000000000002 already_locked = true authenticated = true instance_id = 1a5c861f-b142-4554-9da6-cdc902ef7a3f locked_gen = Generation(Generation(2)) saga_id = ad8b8f45-9ad9-4a38-8661-90e653522be1 saga_name = start-instance-update saga_node = LockInstance updater_id = 127fbdd9-695a-4e8c-91a9-d4befaede45f
80412024-08-16T07:23:59.772ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 0d900881-9285-4dbf-910f-5e4676c8f133
80422024-08-16T07:23:59.772ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(2), "updater_id": String("127fbdd9-695a-4e8c-91a9-d4befaede45f")}) node_id = 1 saga_id = ad8b8f45-9ad9-4a38-8661-90e653522be1
80432024-08-16T07:23:59.776ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 0d900881-9285-4dbf-910f-5e4676c8f133
80442024-08-16T07:23:59.776ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = ad8b8f45-9ad9-4a38-8661-90e653522be1
80452024-08-16T07:23:59.779ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ad8b8f45-9ad9-4a38-8661-90e653522be1 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
80462024-08-16T07:23:59.779ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ad8b8f45-9ad9-4a38-8661-90e653522be1 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
80472024-08-16T07:23:59.780ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ad8b8f45-9ad9-4a38-8661-90e653522be1 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
80482024-08-16T07:23:59.780ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ad8b8f45-9ad9-4a38-8661-90e653522be1 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
80492024-08-16T07:23:59.781ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ad8b8f45-9ad9-4a38-8661-90e653522be1 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
80502024-08-16T07:23:59.782ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ad8b8f45-9ad9-4a38-8661-90e653522be1 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
80512024-08-16T07:23:59.782ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = ad8b8f45-9ad9-4a38-8661-90e653522be1 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
80522024-08-16T07:23:59.785ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, lookup_type: ById(439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071) }, key: dcc6705f-5b5d-4019-b465-b7f78edf8c56, lookup_type: ById(dcc6705f-5b5d-4019-b465-b7f78edf8c56) }, key: 1a5c861f-b142-4554-9da6-cdc902ef7a3f, lookup_type: ById(1a5c861f-b142-4554-9da6-cdc902ef7a3f) } result = Ok(()) saga_id = ad8b8f45-9ad9-4a38-8661-90e653522be1 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
80532024-08-16T07:23:59.785ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ad8b8f45-9ad9-4a38-8661-90e653522be1 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
80542024-08-16T07:23:59.785ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ad8b8f45-9ad9-4a38-8661-90e653522be1 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
80552024-08-16T07:23:59.795ZINFOnexus (SagaExecutor): instance update: starting real update saga... current.active_vmm = Some(Vmm { id: 0cf6e496-975f-45c7-be02-aad19df20905, time_created: 2024-08-16T07:23:39.350614Z, time_deleted: None, instance_id: 1a5c861f-b142-4554-9da6-cdc902ef7a3f, sled_id: 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae, propolis_ip: V6(Ipv6Network { addr: fd00:1122:3344:101::1:0, prefix: 128 }), propolis_port: SqlU16(12400), runtime: VmmRuntimeState { time_state_updated: 2024-08-16T07:23:59.598952Z, gen: Generation(Generation(7)), state: Destroyed } }) current.migration = None current.runtime_state = InstanceRuntimeState { time_updated: 2024-08-16T07:23:39.387404Z, gen: Generation(Generation(3)), propolis_id: Some(0cf6e496-975f-45c7-be02-aad19df20905), dst_propolis_id: None, migration_id: None, nexus_state: Vmm } current.target_vmm = None file = nexus/src/app/sagas/instance_update/start.rs:180 instance_id = 1a5c861f-b142-4554-9da6-cdc902ef7a3f saga_id = ad8b8f45-9ad9-4a38-8661-90e653522be1 saga_name = start-instance-update update.deprovision = true update.destroy_active_vmm = Some(0cf6e496-975f-45c7-be02-aad19df20905 (propolis)) update.destroy_target_vmm = None update.network_config_update = Some(Delete) update.new_runtime_state = InstanceRuntimeState { time_updated: 2024-08-16T07:23:59.792832557Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm }
80562024-08-16T07:23:59.796ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 4996e5bc-f575-4cc6-85af-9b60f3ae1efb roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
80572024-08-16T07:23:59.796ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 4996e5bc-f575-4cc6-85af-9b60f3ae1efb resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
80582024-08-16T07:23:59.797ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:212 saga_id = c6d9e876-c625-497f-8edb-ca529183e5ba saga_name = instance-update
80592024-08-16T07:23:59.797ZINFOnexus (SEC): saga create dag = {"end_node":13,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,10,null],[8,9,null],[10,11,null],[12,0,null],[11,13,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"instance_update.become_updater","label":"BecomeUpdater","name":"updater_lock"}},{"Constant":{"name":"network_config_update","value":"Delete"}},{"Action":{"action_name":"instance_update.update_network_config","label":"UpdateNetworkConfig","name":"update_network_config"}},{"Action":{"action_name":"instance_update.release_virtual_provisioning","label":"ReleaseVirtualProvisioning","name":"release_virtual_provisioning"}},{"Action":{"action_name":"instance_update.unassign_oximeter_producer","label":"UnassignOximeterProducer","name":"unassign_oximeter_producer"}},{"Action":{"action_name":"instance_update.commit_instance_updates","label":"CommitInstanceUpdates","name":"commit_instance_updates"}},{"Constant":{"name":"destroy_active_vmm_params","value":{"instance_id":"1a5c861f-b142-4554-9da6-cdc902ef7a3f","serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"vmm_id":"0cf6e496-975f-45c7-be02-aad19df20905"}}},{"SubsagaStart":{"params_node_name":"destroy_active_vmm_params","saga_name":"destroy_active_vmm"}},{"Action":{"action_name":"destroy_vmm.release_sled_resources","label":"ReleaseSledResources","name":"release_sled_resources"}},{"Action":{"action_name":"destroy_vmm.mark_vmm_deleted","label":"MarkVmmDeleted","name":"mark_vmm_deleted"}},{"SubsagaEnd":{"name":"active_vmm_destroyed"}},{"Start":{"params":{"authz_instance":{"key":"1a5c861f-b142-4554-9da6-cdc902ef7a3f","lookup_type":{"ById":"1a5c861f-b142-4554-9da6-cdc902ef7a3f"},"parent":{"key":"dcc6705f-5b5d-4019-b465-b7f78edf8c56","lookup_type":{"ById":"dcc6705f-5b5d-4019-b465-b7f78edf8c56"},"parent":{"key":"439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071","lookup_type":{"ById":"439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071"},"parent":null}}},"orig_lock":{"locked_gen":2,"updater_id":"127fbdd9-695a-4e8c-91a9-d4befaede45f"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"update":{"deprovision":{"cpus_diff":2,"project_id":"dcc6705f-5b5d-4019-b465-b7f78edf8c56","ram_diff":1073741824},"destroy_active_vmm":"0cf6e496-975f-45c7-be02-aad19df20905","destroy_target_vmm":null,"network_config":"Delete","new_runtime":{"dst_propolis_id":null,"gen":4,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_updated":"2024-08-16T07:23:59.792832557Z"}}}}},"End"]},"saga_name":"instance-update","start_node":12} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = c6d9e876-c625-497f-8edb-ca529183e5ba saga_name = instance-update sec_id = 0d900881-9285-4dbf-910f-5e4676c8f133
80602024-08-16T07:23:59.797ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = c6d9e876-c625-497f-8edb-ca529183e5ba saga_name = instance-update
80612024-08-16T07:23:59.798ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2271 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 4996e5bc-f575-4cc6-85af-9b60f3ae1efb response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
80622024-08-16T07:23:59.828ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:310 saga_id = c6d9e876-c625-497f-8edb-ca529183e5ba saga_name = instance-update
80632024-08-16T07:23:59.828ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = c6d9e876-c625-497f-8edb-ca529183e5ba saga_name = instance-update sec_id = 0d900881-9285-4dbf-910f-5e4676c8f133
80642024-08-16T07:23:59.828ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 0d900881-9285-4dbf-910f-5e4676c8f133
80652024-08-16T07:23:59.828ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = c6d9e876-c625-497f-8edb-ca529183e5ba
80662024-08-16T07:23:59.831ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 0d900881-9285-4dbf-910f-5e4676c8f133
80672024-08-16T07:23:59.831ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = c6d9e876-c625-497f-8edb-ca529183e5ba
80682024-08-16T07:23:59.833ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 0d900881-9285-4dbf-910f-5e4676c8f133
80692024-08-16T07:23:59.833ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = c6d9e876-c625-497f-8edb-ca529183e5ba
80702024-08-16T07:23:59.836ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 0d900881-9285-4dbf-910f-5e4676c8f133
80712024-08-16T07:23:59.836ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("3b107505-ec30-44cc-8413-363b2b55a5e9")) node_id = 0 saga_id = c6d9e876-c625-497f-8edb-ca529183e5ba
80722024-08-16T07:23:59.839ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 0d900881-9285-4dbf-910f-5e4676c8f133
80732024-08-16T07:23:59.839ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = c6d9e876-c625-497f-8edb-ca529183e5ba
80742024-08-16T07:23:59.841ZDEBGnexus (SagaExecutor): instance update: trying to become instance updater... instance_id = 1a5c861f-b142-4554-9da6-cdc902ef7a3f parent_lock = UpdaterLock { updater_id: 127fbdd9-695a-4e8c-91a9-d4befaede45f, locked_gen: Generation(Generation(2)) } saga_id = c6d9e876-c625-497f-8edb-ca529183e5ba saga_name = instance-update
80752024-08-16T07:23:59.841ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = c6d9e876-c625-497f-8edb-ca529183e5ba saga_name = instance-update saga_node = BecomeUpdater
80762024-08-16T07:23:59.841ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = c6d9e876-c625-497f-8edb-ca529183e5ba saga_name = instance-update saga_node = BecomeUpdater
80772024-08-16T07:23:59.849ZDEBGnexus (SagaExecutor): inherited lock from 127fbdd9-695a-4e8c-91a9-d4befaede45f to 3b107505-ec30-44cc-8413-363b2b55a5e9 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 1a5c861f-b142-4554-9da6-cdc902ef7a3f locked_gen = Generation(Generation(3)) parent_gen = Generation(Generation(2)) parent_id = 127fbdd9-695a-4e8c-91a9-d4befaede45f saga_id = c6d9e876-c625-497f-8edb-ca529183e5ba saga_name = instance-update saga_node = BecomeUpdater updater_id = 3b107505-ec30-44cc-8413-363b2b55a5e9
80782024-08-16T07:23:59.849ZINFOnexus (SagaExecutor): instance_update: Now, I am become Updater, the destroyer of VMMs. file = nexus/src/app/sagas/instance_update/mod.rs:933 instance_id = 1a5c861f-b142-4554-9da6-cdc902ef7a3f saga_id = c6d9e876-c625-497f-8edb-ca529183e5ba saga_name = instance-update
80792024-08-16T07:23:59.849ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 0d900881-9285-4dbf-910f-5e4676c8f133
80802024-08-16T07:23:59.849ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(3), "updater_id": String("3b107505-ec30-44cc-8413-363b2b55a5e9")}) node_id = 1 saga_id = c6d9e876-c625-497f-8edb-ca529183e5ba
80812024-08-16T07:23:59.852ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 0d900881-9285-4dbf-910f-5e4676c8f133
80822024-08-16T07:23:59.852ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = c6d9e876-c625-497f-8edb-ca529183e5ba
80832024-08-16T07:23:59.855ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 0d900881-9285-4dbf-910f-5e4676c8f133
80842024-08-16T07:23:59.855ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("Delete")) node_id = 2 saga_id = c6d9e876-c625-497f-8edb-ca529183e5ba
80852024-08-16T07:23:59.858ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 0d900881-9285-4dbf-910f-5e4676c8f133
80862024-08-16T07:23:59.858ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = c6d9e876-c625-497f-8edb-ca529183e5ba
80872024-08-16T07:23:59.862ZINFOnexus (SagaExecutor): instance update: deleting network config file = nexus/src/app/sagas/instance_update/mod.rs:986 instance_id = 1a5c861f-b142-4554-9da6-cdc902ef7a3f saga_id = c6d9e876-c625-497f-8edb-ca529183e5ba saga_name = instance-update
80882024-08-16T07:23:59.864ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = 1a5c861f-b142-4554-9da6-cdc902ef7a3f
80892024-08-16T07:23:59.864ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = c6d9e876-c625-497f-8edb-ca529183e5ba saga_name = instance-update saga_node = UpdateNetworkConfig
80902024-08-16T07:23:59.865ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = c6d9e876-c625-497f-8edb-ca529183e5ba saga_name = instance-update saga_node = UpdateNetworkConfig
80912024-08-16T07:23:59.869ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = c6d9e876-c625-497f-8edb-ca529183e5ba saga_name = instance-update saga_node = UpdateNetworkConfig
80922024-08-16T07:23:59.869ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = c6d9e876-c625-497f-8edb-ca529183e5ba saga_name = instance-update saga_node = UpdateNetworkConfig
80932024-08-16T07:23:59.875ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
80942024-08-16T07:23:59.875ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = c6d9e876-c625-497f-8edb-ca529183e5ba saga_name = instance-update saga_node = UpdateNetworkConfig
80952024-08-16T07:23:59.875ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = c6d9e876-c625-497f-8edb-ca529183e5ba saga_name = instance-update saga_node = UpdateNetworkConfig
80962024-08-16T07:23:59.876ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
80972024-08-16T07:23:59.876ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
80982024-08-16T07:23:59.877ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
80992024-08-16T07:23:59.877ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
81002024-08-16T07:23:59.878ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
81012024-08-16T07:23:59.878ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
81022024-08-16T07:23:59.879ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
81032024-08-16T07:23:59.886ZDEBGnexus: notifying dendrite of updates instance_id = Some(1a5c861f-b142-4554-9da6-cdc902ef7a3f (instance)) switch = switch0
81042024-08-16T07:23:59.887ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1503, tv_nsec: 264826970 } })
81052024-08-16T07:23:59.887ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1050
81062024-08-16T07:23:59.919ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
81072024-08-16T07:23:59.919ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
81082024-08-16T07:23:59.920ZDEBGnexus (MgsClient): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "14699aba-3e42-4ea9-acf2-fc06260e8a17", "content-length": "26", "date": "Fri, 16 Aug 2024 07:23:59 GMT"} })
81092024-08-16T07:23:59.920ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
81102024-08-16T07:23:59.921ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
81112024-08-16T07:23:59.951ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
81122024-08-16T07:23:59.951ZDEBGnexus (DpdClient): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/trigger", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "795eebe3-cf8f-4697-b3fe-b677f8b1472e", "content-length": "4", "date": "Fri, 16 Aug 2024 07:23:59 GMT"} })
81132024-08-16T07:23:59.952ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 0d900881-9285-4dbf-910f-5e4676c8f133
81142024-08-16T07:23:59.952ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = c6d9e876-c625-497f-8edb-ca529183e5ba
81152024-08-16T07:23:59.955ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 0d900881-9285-4dbf-910f-5e4676c8f133
81162024-08-16T07:23:59.955ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = c6d9e876-c625-497f-8edb-ca529183e5ba
81172024-08-16T07:23:59.960ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = c6d9e876-c625-497f-8edb-ca529183e5ba saga_name = instance-update saga_node = ReleaseVirtualProvisioning
81182024-08-16T07:23:59.960ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = c6d9e876-c625-497f-8edb-ca529183e5ba saga_name = instance-update saga_node = ReleaseVirtualProvisioning
81192024-08-16T07:23:59.975ZINFOnexus (SagaExecutor): instance update (no VMM): deallocated virtual provisioning resources file = nexus/src/app/sagas/instance_update/mod.rs:1061 instance_id = 1a5c861f-b142-4554-9da6-cdc902ef7a3f records_deleted = [VirtualProvisioningCollection { id: 001de000-1334-4000-8000-000000000000, time_modified: Some(2024-08-16T07:23:59.965713Z), collection_type: "Fleet", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, time_modified: Some(2024-08-16T07:23:59.965713Z), collection_type: "Silo", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: dcc6705f-5b5d-4019-b465-b7f78edf8c56, time_modified: Some(2024-08-16T07:23:59.965713Z), collection_type: "Project", virtual_disk_bytes_provisioned: ByteCount(ByteCount(2147483648)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }] saga_id = c6d9e876-c625-497f-8edb-ca529183e5ba saga_name = instance-update
81202024-08-16T07:23:59.975ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 0d900881-9285-4dbf-910f-5e4676c8f133
81212024-08-16T07:23:59.975ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = c6d9e876-c625-497f-8edb-ca529183e5ba
81222024-08-16T07:23:59.978ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 0d900881-9285-4dbf-910f-5e4676c8f133
81232024-08-16T07:23:59.978ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = c6d9e876-c625-497f-8edb-ca529183e5ba
81242024-08-16T07:23:59.981ZINFOnexus (SagaExecutor): instance update (no VMM): unassigning oximeter producer file = nexus/src/app/sagas/instance_update/mod.rs:1096 instance_id = 1a5c861f-b142-4554-9da6-cdc902ef7a3f saga_id = c6d9e876-c625-497f-8edb-ca529183e5ba saga_name = instance-update
81252024-08-16T07:23:59.981ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = c6d9e876-c625-497f-8edb-ca529183e5ba saga_name = instance-update saga_node = UnassignOximeterProducer
81262024-08-16T07:23:59.981ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = c6d9e876-c625-497f-8edb-ca529183e5ba saga_name = instance-update saga_node = UnassignOximeterProducer
81272024-08-16T07:23:59.988ZDEBGnexus (SagaExecutor): deleted metric producer assignment collector_id = 62147b68-6c5f-49df-a144-ebe1b87f0e27 producer_id = 1a5c861f-b142-4554-9da6-cdc902ef7a3f saga_id = c6d9e876-c625-497f-8edb-ca529183e5ba saga_name = instance-update
81282024-08-16T07:23:59.989ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = c6d9e876-c625-497f-8edb-ca529183e5ba saga_name = instance-update saga_node = UnassignOximeterProducer
81292024-08-16T07:23:59.989ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = c6d9e876-c625-497f-8edb-ca529183e5ba saga_name = instance-update saga_node = UnassignOximeterProducer
81302024-08-16T07:24:00.033ZINFOnexus (SagaExecutor): registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 1a5c861f-b142-4554-9da6-cdc902ef7a3f saga_id = c6d9e876-c625-497f-8edb-ca529183e5ba saga_name = instance-update
81312024-08-16T07:24:00.033ZDEBGnexus (SagaExecutor): client request body = None method = DELETE oximeter-collector = 1a5c861f-b142-4554-9da6-cdc902ef7a3f saga_id = c6d9e876-c625-497f-8edb-ca529183e5ba saga_name = instance-update uri = http://[fd00:1122:3344:101::d]:12223/producers/1a5c861f-b142-4554-9da6-cdc902ef7a3f
81322024-08-16T07:24:00.037ZDEBGnexus (SagaExecutor): client response oximeter-collector = 1a5c861f-b142-4554-9da6-cdc902ef7a3f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers/1a5c861f-b142-4554-9da6-cdc902ef7a3f", query: None, fragment: None }, status: 204, headers: {"x-request-id": "b75c7ef6-d6d5-4767-92ef-9f329ce13e39", "date": "Fri, 16 Aug 2024 07:24:00 GMT"} }) saga_id = c6d9e876-c625-497f-8edb-ca529183e5ba saga_name = instance-update
81332024-08-16T07:24:00.037ZDEBGnexus (SagaExecutor): successfully deleted producer from collector address = [fd00:1122:3344:101::d]:12223 collector_id = 62147b68-6c5f-49df-a144-ebe1b87f0e27 producer_id = 1a5c861f-b142-4554-9da6-cdc902ef7a3f saga_id = c6d9e876-c625-497f-8edb-ca529183e5ba saga_name = instance-update
81342024-08-16T07:24:00.038ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 0d900881-9285-4dbf-910f-5e4676c8f133
81352024-08-16T07:24:00.038ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = c6d9e876-c625-497f-8edb-ca529183e5ba
81362024-08-16T07:24:00.043ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 0d900881-9285-4dbf-910f-5e4676c8f133
81372024-08-16T07:24:00.043ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = c6d9e876-c625-497f-8edb-ca529183e5ba
81382024-08-16T07:24:00.046ZDEBGnexus (SagaExecutor): instance update: committing new runtime state and unlocking... instance_id = 1a5c861f-b142-4554-9da6-cdc902ef7a3f lock = UpdaterLock { updater_id: 3b107505-ec30-44cc-8413-363b2b55a5e9, locked_gen: Generation(Generation(3)) } new_runtime = InstanceRuntimeState { time_updated: 2024-08-16T07:23:59.792832557Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm } saga_id = c6d9e876-c625-497f-8edb-ca529183e5ba saga_name = instance-update
81392024-08-16T07:24:00.046ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = c6d9e876-c625-497f-8edb-ca529183e5ba saga_name = instance-update saga_node = CommitInstanceUpdates
81402024-08-16T07:24:00.046ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = c6d9e876-c625-497f-8edb-ca529183e5ba saga_name = instance-update saga_node = CommitInstanceUpdates
81412024-08-16T07:24:00.084ZINFOnexus (SagaExecutor): instance update: committed update new runtime state! did_unlock = true file = nexus/src/app/sagas/instance_update/mod.rs:1145 instance_id = 1a5c861f-b142-4554-9da6-cdc902ef7a3f new_runtime = InstanceRuntimeState { time_updated: 2024-08-16T07:23:59.792832557Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm } saga_id = c6d9e876-c625-497f-8edb-ca529183e5ba saga_name = instance-update
81422024-08-16T07:24:00.084ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = c6d9e876-c625-497f-8edb-ca529183e5ba saga_name = instance-update saga_node = CommitInstanceUpdates
81432024-08-16T07:24:00.085ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 16 reason = Signaled
81442024-08-16T07:24:00.085ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
81452024-08-16T07:24:00.085ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = c6d9e876-c625-497f-8edb-ca529183e5ba saga_name = instance-update saga_node = CommitInstanceUpdates
81462024-08-16T07:24:00.085ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 16 reason = Signaled
81472024-08-16T07:24:00.085ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81482024-08-16T07:24:00.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
81492024-08-16T07:24:00.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81502024-08-16T07:24:00.086ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = c6d9e876-c625-497f-8edb-ca529183e5ba saga_name = instance-update saga_node = CommitInstanceUpdates
81512024-08-16T07:24:00.086ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = c6d9e876-c625-497f-8edb-ca529183e5ba saga_name = instance-update saga_node = CommitInstanceUpdates
81522024-08-16T07:24:00.086ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81532024-08-16T07:24:00.087ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = c6d9e876-c625-497f-8edb-ca529183e5ba saga_name = instance-update saga_node = CommitInstanceUpdates
81542024-08-16T07:24:00.087ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = c6d9e876-c625-497f-8edb-ca529183e5ba saga_name = instance-update saga_node = CommitInstanceUpdates
81552024-08-16T07:24:00.087ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
81562024-08-16T07:24:00.087ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81572024-08-16T07:24:00.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81582024-08-16T07:24:00.088ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = c6d9e876-c625-497f-8edb-ca529183e5ba saga_name = instance-update saga_node = CommitInstanceUpdates
81592024-08-16T07:24:00.088ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81602024-08-16T07:24:00.090ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
81612024-08-16T07:24:00.090ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81622024-08-16T07:24:00.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81632024-08-16T07:24:00.091ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, lookup_type: ById(439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071) }, key: dcc6705f-5b5d-4019-b465-b7f78edf8c56, lookup_type: ById(dcc6705f-5b5d-4019-b465-b7f78edf8c56) }, key: 1a5c861f-b142-4554-9da6-cdc902ef7a3f, lookup_type: ById(1a5c861f-b142-4554-9da6-cdc902ef7a3f) } result = Ok(()) saga_id = c6d9e876-c625-497f-8edb-ca529183e5ba saga_name = instance-update saga_node = CommitInstanceUpdates
81642024-08-16T07:24:00.091ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = c6d9e876-c625-497f-8edb-ca529183e5ba saga_name = instance-update saga_node = CommitInstanceUpdates
81652024-08-16T07:24:00.091ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = c6d9e876-c625-497f-8edb-ca529183e5ba saga_name = instance-update saga_node = CommitInstanceUpdates
81662024-08-16T07:24:00.094ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 0d900881-9285-4dbf-910f-5e4676c8f133
81672024-08-16T07:24:00.094ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = c6d9e876-c625-497f-8edb-ca529183e5ba
81682024-08-16T07:24:00.096ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 0d900881-9285-4dbf-910f-5e4676c8f133
81692024-08-16T07:24:00.096ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = c6d9e876-c625-497f-8edb-ca529183e5ba
81702024-08-16T07:24:00.098ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
81712024-08-16T07:24:00.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
81722024-08-16T07:24:00.099ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 0d900881-9285-4dbf-910f-5e4676c8f133
81732024-08-16T07:24:00.099ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"instance_id": String("1a5c861f-b142-4554-9da6-cdc902ef7a3f"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("0cf6e496-975f-45c7-be02-aad19df20905")}) node_id = 7 saga_id = c6d9e876-c625-497f-8edb-ca529183e5ba
81742024-08-16T07:24:00.102ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 0d900881-9285-4dbf-910f-5e4676c8f133
81752024-08-16T07:24:00.102ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = c6d9e876-c625-497f-8edb-ca529183e5ba
81762024-08-16T07:24:00.105ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 0d900881-9285-4dbf-910f-5e4676c8f133
81772024-08-16T07:24:00.105ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = c6d9e876-c625-497f-8edb-ca529183e5ba
81782024-08-16T07:24:00.105ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
81792024-08-16T07:24:00.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
81802024-08-16T07:24:00.106ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81812024-08-16T07:24:00.108ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 0d900881-9285-4dbf-910f-5e4676c8f133
81822024-08-16T07:24:00.108ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = c6d9e876-c625-497f-8edb-ca529183e5ba
81832024-08-16T07:24:00.108ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
81842024-08-16T07:24:00.108ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
81852024-08-16T07:24:00.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
81862024-08-16T07:24:00.109ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81872024-08-16T07:24:00.110ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
81882024-08-16T07:24:00.110ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
81892024-08-16T07:24:00.110ZINFOnexus (SagaExecutor): instance update (VMM destroyed): deallocating sled resource reservation file = nexus/src/app/sagas/instance_update/destroyed.rs:83 instance_id = 1a5c861f-b142-4554-9da6-cdc902ef7a3f propolis_id = 0cf6e496-975f-45c7-be02-aad19df20905 saga_id = c6d9e876-c625-497f-8edb-ca529183e5ba saga_name = instance-update
81902024-08-16T07:24:00.110ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = c6d9e876-c625-497f-8edb-ca529183e5ba saga_name = instance-update saga_node = ReleaseSledResources
81912024-08-16T07:24:00.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
81922024-08-16T07:24:00.111ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = c6d9e876-c625-497f-8edb-ca529183e5ba saga_name = instance-update saga_node = ReleaseSledResources
81932024-08-16T07:24:00.117ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 0d900881-9285-4dbf-910f-5e4676c8f133
81942024-08-16T07:24:00.117ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = c6d9e876-c625-497f-8edb-ca529183e5ba
81952024-08-16T07:24:00.119ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 0d900881-9285-4dbf-910f-5e4676c8f133
81962024-08-16T07:24:00.119ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = c6d9e876-c625-497f-8edb-ca529183e5ba
81972024-08-16T07:24:00.122ZINFOnexus (SagaExecutor): instance update (VMM destroyed): marking VMM record deleted file = nexus/src/app/sagas/instance_update/destroyed.rs:114 instance_id = 1a5c861f-b142-4554-9da6-cdc902ef7a3f propolis_id = 0cf6e496-975f-45c7-be02-aad19df20905 saga_id = c6d9e876-c625-497f-8edb-ca529183e5ba saga_name = instance-update
81982024-08-16T07:24:00.122ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = c6d9e876-c625-497f-8edb-ca529183e5ba saga_name = instance-update saga_node = MarkVmmDeleted
81992024-08-16T07:24:00.122ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = c6d9e876-c625-497f-8edb-ca529183e5ba saga_name = instance-update saga_node = MarkVmmDeleted
82002024-08-16T07:24:00.123ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64556 req_id = e8b7eba6-5cab-426b-a6f7-7fd51743364b roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
82012024-08-16T07:24:00.124ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64556 req_id = e8b7eba6-5cab-426b-a6f7-7fd51743364b resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
82022024-08-16T07:24:00.124ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
82032024-08-16T07:24:00.125ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d6cf5951-ac27-4da6-8631-f28ef7a46f08", "content-length": "372", "date": "Fri, 16 Aug 2024 07:24:00 GMT"} })
82042024-08-16T07:24:00.125ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
82052024-08-16T07:24:00.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
82062024-08-16T07:24:00.125ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1691 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64556 req_id = e8b7eba6-5cab-426b-a6f7-7fd51743364b response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
82072024-08-16T07:24:00.126ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
82082024-08-16T07:24:00.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
82092024-08-16T07:24:00.128ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
82102024-08-16T07:24:00.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
82112024-08-16T07:24:00.130ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 0d900881-9285-4dbf-910f-5e4676c8f133
82122024-08-16T07:24:00.130ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = c6d9e876-c625-497f-8edb-ca529183e5ba
82132024-08-16T07:24:00.131ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
82142024-08-16T07:24:00.131ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "982569ed-1afb-4088-8e40-ed80886f82e4", "date": "Fri, 16 Aug 2024 07:24:00 GMT"} })
82152024-08-16T07:24:00.132ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 47.147948ms iteration = 16 status = {}
82162024-08-16T07:24:00.135ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 0d900881-9285-4dbf-910f-5e4676c8f133
82172024-08-16T07:24:00.135ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = c6d9e876-c625-497f-8edb-ca529183e5ba
82182024-08-16T07:24:00.143ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 0d900881-9285-4dbf-910f-5e4676c8f133
82192024-08-16T07:24:00.143ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = c6d9e876-c625-497f-8edb-ca529183e5ba
82202024-08-16T07:24:00.146ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
82212024-08-16T07:24:00.146ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c5eeeb64-968d-4a33-a992-78755204047b", "content-length": "691", "date": "Fri, 16 Aug 2024 07:24:00 GMT"} })
82222024-08-16T07:24:00.146ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
82232024-08-16T07:24:00.146ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
82242024-08-16T07:24:00.146ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
82252024-08-16T07:24:00.147ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 0d900881-9285-4dbf-910f-5e4676c8f133
82262024-08-16T07:24:00.147ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = c6d9e876-c625-497f-8edb-ca529183e5ba
82272024-08-16T07:24:00.147ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 62.988924ms iteration = 16 status = {}
82282024-08-16T07:24:00.152ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 0d900881-9285-4dbf-910f-5e4676c8f133
82292024-08-16T07:24:00.152ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = c6d9e876-c625-497f-8edb-ca529183e5ba
82302024-08-16T07:24:00.156ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = c6d9e876-c625-497f-8edb-ca529183e5ba sec_id = 0d900881-9285-4dbf-910f-5e4676c8f133
82312024-08-16T07:24:00.156ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = c6d9e876-c625-497f-8edb-ca529183e5ba
82322024-08-16T07:24:00.196ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = c6d9e876-c625-497f-8edb-ca529183e5ba saga_name = instance-update sec_id = 0d900881-9285-4dbf-910f-5e4676c8f133
82332024-08-16T07:24:00.196ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:361 saga_id = c6d9e876-c625-497f-8edb-ca529183e5ba saga_name = instance-update saga_result = SagaResult { saga_id: c6d9e876-c625-497f-8edb-ca529183e5ba, saga_log: SagaLog { saga_id: c6d9e876-c625-497f-8edb-ca529183e5ba, unwinding: false, events: [N012 started, N012 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N013 started, N013 succeeded], node_status: {0: Succeeded(String("3b107505-ec30-44cc-8413-363b2b55a5e9")), 1: Succeeded(Object {"locked_gen": Number(3), "updater_id": String("3b107505-ec30-44cc-8413-363b2b55a5e9")}), 2: Succeeded(String("Delete")), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Object {"instance_id": String("1a5c861f-b142-4554-9da6-cdc902ef7a3f"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("0cf6e496-975f-45c7-be02-aad19df20905")}), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"active_vmm_destroyed": Null, "commit_instance_updates": Null, "destroy_active_vmm_params": Object {"instance_id": String("1a5c861f-b142-4554-9da6-cdc902ef7a3f"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("0cf6e496-975f-45c7-be02-aad19df20905")}, "mark_vmm_deleted": Null, "network_config_update": String("Delete"), "release_sled_resources": Null, "release_virtual_provisioning": Null, "saga_instance_lock_id": String("3b107505-ec30-44cc-8413-363b2b55a5e9"), "unassign_oximeter_producer": Null, "update_network_config": Null, "updater_lock": Object {"locked_gen": Number(3), "updater_id": String("3b107505-ec30-44cc-8413-363b2b55a5e9")}} }) }
82342024-08-16T07:24:00.196ZDEBGnexus (SagaExecutor): instance update: child saga completed successfully child_saga_id = c6d9e876-c625-497f-8edb-ca529183e5ba instance_id = 1a5c861f-b142-4554-9da6-cdc902ef7a3f saga_id = ad8b8f45-9ad9-4a38-8661-90e653522be1 saga_name = start-instance-update
82352024-08-16T07:24:00.196ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 0d900881-9285-4dbf-910f-5e4676c8f133
82362024-08-16T07:24:00.196ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = ad8b8f45-9ad9-4a38-8661-90e653522be1
82372024-08-16T07:24:00.202ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 0d900881-9285-4dbf-910f-5e4676c8f133
82382024-08-16T07:24:00.202ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = ad8b8f45-9ad9-4a38-8661-90e653522be1
82392024-08-16T07:24:00.206ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 0d900881-9285-4dbf-910f-5e4676c8f133
82402024-08-16T07:24:00.206ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = ad8b8f45-9ad9-4a38-8661-90e653522be1
82412024-08-16T07:24:00.210ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = ad8b8f45-9ad9-4a38-8661-90e653522be1 sec_id = 0d900881-9285-4dbf-910f-5e4676c8f133
82422024-08-16T07:24:00.210ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = ad8b8f45-9ad9-4a38-8661-90e653522be1
82432024-08-16T07:24:00.243ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = ad8b8f45-9ad9-4a38-8661-90e653522be1 saga_name = start-instance-update sec_id = 0d900881-9285-4dbf-910f-5e4676c8f133
82442024-08-16T07:24:00.243ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:361 saga_id = ad8b8f45-9ad9-4a38-8661-90e653522be1 saga_name = start-instance-update saga_result = SagaResult { saga_id: ad8b8f45-9ad9-4a38-8661-90e653522be1, saga_log: SagaLog { saga_id: ad8b8f45-9ad9-4a38-8661-90e653522be1, unwinding: false, events: [N003 started, N003 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N004 started, N004 succeeded], node_status: {0: Succeeded(String("127fbdd9-695a-4e8c-91a9-d4befaede45f")), 1: Succeeded(Object {"locked_gen": Number(2), "updater_id": String("127fbdd9-695a-4e8c-91a9-d4befaede45f")}), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"saga_instance_lock_id": String("127fbdd9-695a-4e8c-91a9-d4befaede45f"), "state": Null, "updater_lock": Object {"locked_gen": Number(2), "updater_id": String("127fbdd9-695a-4e8c-91a9-d4befaede45f")}} }) }
82452024-08-16T07:24:00.817ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 6b7d426e-dab5-41db-b74b-02e3d767de29 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
82462024-08-16T07:24:00.818ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 6b7d426e-dab5-41db-b74b-02e3d767de29 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
82472024-08-16T07:24:00.819ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2228 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 6b7d426e-dab5-41db-b74b-02e3d767de29 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
82482024-08-16T07:24:00.854ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 44 reason = Timeout
82492024-08-16T07:24:00.854ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82502024-08-16T07:24:00.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82512024-08-16T07:24:00.856ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82522024-08-16T07:24:00.858ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
82532024-08-16T07:24:00.858ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82542024-08-16T07:24:00.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82552024-08-16T07:24:00.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82562024-08-16T07:24:00.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82572024-08-16T07:24:00.861ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 44 reason = Timeout
82582024-08-16T07:24:00.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82592024-08-16T07:24:00.861ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
82602024-08-16T07:24:00.861ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82612024-08-16T07:24:00.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
82622024-08-16T07:24:00.863ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82632024-08-16T07:24:00.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
82642024-08-16T07:24:00.863ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
82652024-08-16T07:24:00.863ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82662024-08-16T07:24:00.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82672024-08-16T07:24:00.864ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
82682024-08-16T07:24:00.864ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.156753ms iteration = 44 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
82692024-08-16T07:24:00.869ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
82702024-08-16T07:24:00.869ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 14.911085ms iteration = 44 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
82712024-08-16T07:24:01.679ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 798 local_addr = [fd00:1122:3344:101::c]:53719 method = GET remote_addr = [fd00:1122:3344:101::d]:60737 req_id = 53ba5e92-44a1-4ee7-9b40-529463c75302 response_code = 200 uri = /0d900881-9285-4dbf-910f-5e4676c8f133
82722024-08-16T07:24:01.839ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = f28991a0-6dbc-467a-8dbd-51610aa0076f roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
82732024-08-16T07:24:01.839ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = f28991a0-6dbc-467a-8dbd-51610aa0076f resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
82742024-08-16T07:24:01.841ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1759 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = f28991a0-6dbc-467a-8dbd-51610aa0076f response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
82752024-08-16T07:24:02.129ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64556 req_id = e25604fd-b6cd-4be3-a822-83ebd3c0e3fa roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
82762024-08-16T07:24:02.129ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64556 req_id = e25604fd-b6cd-4be3-a822-83ebd3c0e3fa resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
82772024-08-16T07:24:02.131ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 3072 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64556 req_id = e25604fd-b6cd-4be3-a822-83ebd3c0e3fa response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
82782024-08-16T07:24:02.860ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = fc64c8b3-b572-4a35-8d05-8c2b35041ef7 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
82792024-08-16T07:24:02.860ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = fc64c8b3-b572-4a35-8d05-8c2b35041ef7 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
82802024-08-16T07:24:02.862ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2028 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = fc64c8b3-b572-4a35-8d05-8c2b35041ef7 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
82812024-08-16T07:24:03.882ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 9fce6610-1cdd-4cdd-9b8b-d3021bf29000 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
82822024-08-16T07:24:03.882ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 9fce6610-1cdd-4cdd-9b8b-d3021bf29000 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
82832024-08-16T07:24:03.884ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2356 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 9fce6610-1cdd-4cdd-9b8b-d3021bf29000 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
82842024-08-16T07:24:04.903ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 8f343562-4713-4e4c-a4b6-21ce8c0f3825 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
82852024-08-16T07:24:04.904ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 8f343562-4713-4e4c-a4b6-21ce8c0f3825 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
82862024-08-16T07:24:04.906ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2528 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 8f343562-4713-4e4c-a4b6-21ce8c0f3825 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
82872024-08-16T07:24:05.925ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 878e9575-db57-422c-b4e5-661d49d00a94 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
82882024-08-16T07:24:05.926ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 878e9575-db57-422c-b4e5-661d49d00a94 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
82892024-08-16T07:24:05.928ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2684 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 878e9575-db57-422c-b4e5-661d49d00a94 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
82902024-08-16T07:24:06.948ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 382a6784-20f8-44c7-8379-e8ded0b58c15 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
82912024-08-16T07:24:06.948ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 382a6784-20f8-44c7-8379-e8ded0b58c15 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
82922024-08-16T07:24:06.950ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2252 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 382a6784-20f8-44c7-8379-e8ded0b58c15 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
82932024-08-16T07:24:07.970ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = cc13c8fc-d65e-4ac7-805b-d772aa4a89b9 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
82942024-08-16T07:24:07.971ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = cc13c8fc-d65e-4ac7-805b-d772aa4a89b9 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
82952024-08-16T07:24:07.972ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2445 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = cc13c8fc-d65e-4ac7-805b-d772aa4a89b9 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
82962024-08-16T07:24:08.991ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 37ae3b28-f170-4051-8e0f-139c0af415ee roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
82972024-08-16T07:24:08.992ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 37ae3b28-f170-4051-8e0f-139c0af415ee resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
82982024-08-16T07:24:08.994ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2506 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 37ae3b28-f170-4051-8e0f-139c0af415ee response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
82992024-08-16T07:24:10.013ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 9147a406-4f7b-4d47-91e6-2e78804fbe4c roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
83002024-08-16T07:24:10.013ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 9147a406-4f7b-4d47-91e6-2e78804fbe4c resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
83012024-08-16T07:24:10.015ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2789 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 9147a406-4f7b-4d47-91e6-2e78804fbe4c response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
83022024-08-16T07:24:10.855ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 45 reason = Timeout
83032024-08-16T07:24:10.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83042024-08-16T07:24:10.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83052024-08-16T07:24:10.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83062024-08-16T07:24:10.860ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
83072024-08-16T07:24:10.860ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83082024-08-16T07:24:10.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83092024-08-16T07:24:10.860ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 45 reason = Timeout
83102024-08-16T07:24:10.860ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
83112024-08-16T07:24:10.860ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
83122024-08-16T07:24:10.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
83132024-08-16T07:24:10.862ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83142024-08-16T07:24:10.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83152024-08-16T07:24:10.862ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
83162024-08-16T07:24:10.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
83172024-08-16T07:24:10.863ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83182024-08-16T07:24:10.864ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
83192024-08-16T07:24:10.864ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.573813ms iteration = 45 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
83202024-08-16T07:24:10.865ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
83212024-08-16T07:24:10.865ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83222024-08-16T07:24:10.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83232024-08-16T07:24:10.871ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
83242024-08-16T07:24:10.871ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 16.260276ms iteration = 45 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
83252024-08-16T07:24:11.035ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = e8573df5-0c81-4aa4-9f71-c207e4f7fc35 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
83262024-08-16T07:24:11.035ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = e8573df5-0c81-4aa4-9f71-c207e4f7fc35 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
83272024-08-16T07:24:11.037ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1824 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = e8573df5-0c81-4aa4-9f71-c207e4f7fc35 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
83282024-08-16T07:24:11.679ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 766 local_addr = [fd00:1122:3344:101::c]:53719 method = GET remote_addr = [fd00:1122:3344:101::d]:60737 req_id = 33269b6d-017d-4c5d-8dec-75ec2b51c137 response_code = 200 uri = /0d900881-9285-4dbf-910f-5e4676c8f133
83292024-08-16T07:24:12.057ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = f27204db-57c6-433c-98cb-eeda480fb429 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
83302024-08-16T07:24:12.057ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = f27204db-57c6-433c-98cb-eeda480fb429 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
83312024-08-16T07:24:12.059ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2089 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = f27204db-57c6-433c-98cb-eeda480fb429 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
83322024-08-16T07:24:13.078ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = d0c9efeb-7c85-4ca3-af11-35621ecbcf1d roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
83332024-08-16T07:24:13.079ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = d0c9efeb-7c85-4ca3-af11-35621ecbcf1d resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
83342024-08-16T07:24:13.080ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2079 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = d0c9efeb-7c85-4ca3-af11-35621ecbcf1d response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
83352024-08-16T07:24:14.100ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = ed763398-d8d7-40f3-80b7-f65352edb3fb roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
83362024-08-16T07:24:14.100ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = ed763398-d8d7-40f3-80b7-f65352edb3fb resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
83372024-08-16T07:24:14.102ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2428 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = ed763398-d8d7-40f3-80b7-f65352edb3fb response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
83382024-08-16T07:24:15.121ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = d41a70de-b2fc-41ee-a8c6-2a04a62a6a57 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
83392024-08-16T07:24:15.122ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = d41a70de-b2fc-41ee-a8c6-2a04a62a6a57 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
83402024-08-16T07:24:15.124ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2668 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = d41a70de-b2fc-41ee-a8c6-2a04a62a6a57 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
83412024-08-16T07:24:16.144ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 1a149edf-0dfb-49d8-abac-107624e42eda roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
83422024-08-16T07:24:16.144ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 1a149edf-0dfb-49d8-abac-107624e42eda resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
83432024-08-16T07:24:16.146ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2302 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 1a149edf-0dfb-49d8-abac-107624e42eda response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
83442024-08-16T07:24:17.165ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = e7d68bdf-4da6-4a2d-93aa-e214b4a41407 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
83452024-08-16T07:24:17.165ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = e7d68bdf-4da6-4a2d-93aa-e214b4a41407 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
83462024-08-16T07:24:17.167ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2146 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = e7d68bdf-4da6-4a2d-93aa-e214b4a41407 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
83472024-08-16T07:24:18.185ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = ab9901c8-a064-4ef3-a0df-553f1a8f536d roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
83482024-08-16T07:24:18.186ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = ab9901c8-a064-4ef3-a0df-553f1a8f536d resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
83492024-08-16T07:24:18.188ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2438 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = ab9901c8-a064-4ef3-a0df-553f1a8f536d response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
83502024-08-16T07:24:19.207ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 210963ec-3715-43c6-a4a2-ecc6bbdae4ae roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
83512024-08-16T07:24:19.207ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 210963ec-3715-43c6-a4a2-ecc6bbdae4ae resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
83522024-08-16T07:24:19.209ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2228 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 210963ec-3715-43c6-a4a2-ecc6bbdae4ae response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
83532024-08-16T07:24:20.229ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = bbab3b10-4e75-4da0-882a-3ad627090cdb roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
83542024-08-16T07:24:20.229ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = bbab3b10-4e75-4da0-882a-3ad627090cdb resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
83552024-08-16T07:24:20.231ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2652 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = bbab3b10-4e75-4da0-882a-3ad627090cdb response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
83562024-08-16T07:24:20.855ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 16 reason = Timeout
83572024-08-16T07:24:20.855ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 16 reason = Timeout
83582024-08-16T07:24:20.855ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
83592024-08-16T07:24:20.855ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
83602024-08-16T07:24:20.855ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 46 reason = Timeout
83612024-08-16T07:24:20.855ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 16 reason = Timeout
83622024-08-16T07:24:20.855ZWARNnexus (BackgroundTasks): phantom disk task started background_task = phantom_disks file = nexus/src/app/background/tasks/phantom_disks.rs:46
83632024-08-16T07:24:20.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83642024-08-16T07:24:20.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
83652024-08-16T07:24:20.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83662024-08-16T07:24:20.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
83672024-08-16T07:24:20.856ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 18 reason = Timeout
83682024-08-16T07:24:20.856ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
83692024-08-16T07:24:20.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
83702024-08-16T07:24:20.858ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83712024-08-16T07:24:20.858ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83722024-08-16T07:24:20.859ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1524, tv_nsec: 237015810 } })
83732024-08-16T07:24:20.859ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1524, tv_nsec: 237159833 } })
83742024-08-16T07:24:20.860ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
83752024-08-16T07:24:20.860ZWARNnexus (BackgroundTasks): phantom disk task done background_task = phantom_disks file = nexus/src/app/background/tasks/phantom_disks.rs:93
83762024-08-16T07:24:20.860ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.647368ms iteration = 16 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
83772024-08-16T07:24:20.860ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
83782024-08-16T07:24:20.860ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
83792024-08-16T07:24:20.860ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
83802024-08-16T07:24:20.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
83812024-08-16T07:24:20.861ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 16 reason = Timeout
83822024-08-16T07:24:20.861ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 16 reason = Timeout
83832024-08-16T07:24:20.861ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
83842024-08-16T07:24:20.861ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 17 reason = Timeout
83852024-08-16T07:24:20.861ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83862024-08-16T07:24:20.861ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
83872024-08-16T07:24:20.861ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 46 reason = Timeout
83882024-08-16T07:24:20.861ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
83892024-08-16T07:24:20.861ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
83902024-08-16T07:24:20.861ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 16 reason = Timeout
83912024-08-16T07:24:20.861ZINFOnexus (BackgroundTasks): region snapshot replacement start task started background_task = region_snapshot_replacement_start file = nexus/src/app/background/tasks/region_snapshot_replacement_start.rs:236
83922024-08-16T07:24:20.861ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
83932024-08-16T07:24:20.861ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 16 reason = Timeout
83942024-08-16T07:24:20.861ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
83952024-08-16T07:24:20.861ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 17 reason = Timeout
83962024-08-16T07:24:20.861ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 16 reason = Timeout
83972024-08-16T07:24:20.861ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
83982024-08-16T07:24:20.861ZWARNnexus (BackgroundTasks): region replacement task started background_task = region_replacement file = nexus/src/app/background/tasks/region_replacement.rs:64
83992024-08-16T07:24:20.861ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
84002024-08-16T07:24:20.861ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 16 reason = Timeout
84012024-08-16T07:24:20.861ZINFOnexus (BackgroundTasks): region snapshot replacement garbage collect task started background_task = region_snapshot_replacement_garbage_collection file = nexus/src/app/background/tasks/region_snapshot_replacement_garbage_collect.rs:133
84022024-08-16T07:24:20.861ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
84032024-08-16T07:24:20.861ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 16 reason = Timeout
84042024-08-16T07:24:20.861ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
84052024-08-16T07:24:20.861ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
84062024-08-16T07:24:20.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
84072024-08-16T07:24:20.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
84082024-08-16T07:24:20.861ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
84092024-08-16T07:24:20.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84102024-08-16T07:24:20.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84112024-08-16T07:24:20.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
84122024-08-16T07:24:20.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
84132024-08-16T07:24:20.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84142024-08-16T07:24:20.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
84152024-08-16T07:24:20.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
84162024-08-16T07:24:20.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84172024-08-16T07:24:20.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
84182024-08-16T07:24:20.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84192024-08-16T07:24:20.862ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84202024-08-16T07:24:20.862ZWARNnexus (BackgroundTasks): physical disk adoption task started background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:100
84212024-08-16T07:24:20.862ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
84222024-08-16T07:24:20.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
84232024-08-16T07:24:20.862ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84242024-08-16T07:24:20.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84252024-08-16T07:24:20.862ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84262024-08-16T07:24:20.863ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84272024-08-16T07:24:20.863ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84282024-08-16T07:24:20.864ZINFOnexus (BackgroundTasks): region snapshot replacement garbage collect task done background_task = region_snapshot_replacement_garbage_collection file = nexus/src/app/background/tasks/region_snapshot_replacement_garbage_collect.rs:147
84292024-08-16T07:24:20.864ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 3.177793ms iteration = 16 status = {"errors":[],"garbage_collect_requested":[]}
84302024-08-16T07:24:20.864ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84312024-08-16T07:24:20.864ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
84322024-08-16T07:24:20.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
84332024-08-16T07:24:20.864ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
84342024-08-16T07:24:20.864ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
84352024-08-16T07:24:20.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
84362024-08-16T07:24:20.865ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
84372024-08-16T07:24:20.865ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.616446ms iteration = 46 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
84382024-08-16T07:24:20.865ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
84392024-08-16T07:24:20.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
84402024-08-16T07:24:20.866ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
84412024-08-16T07:24:20.866ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84422024-08-16T07:24:20.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84432024-08-16T07:24:20.866ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
84442024-08-16T07:24:20.866ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
84452024-08-16T07:24:20.866ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
84462024-08-16T07:24:20.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
84472024-08-16T07:24:20.866ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
84482024-08-16T07:24:20.866ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
84492024-08-16T07:24:20.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
84502024-08-16T07:24:20.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84512024-08-16T07:24:20.867ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
84522024-08-16T07:24:20.867ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
84532024-08-16T07:24:20.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84542024-08-16T07:24:20.867ZWARNnexus (BackgroundTasks): region replacement task done background_task = region_replacement file = nexus/src/app/background/tasks/region_replacement.rs:185
84552024-08-16T07:24:20.867ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 6.196243ms iteration = 16 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
84562024-08-16T07:24:20.867ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
84572024-08-16T07:24:20.867ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
84582024-08-16T07:24:20.867ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
84592024-08-16T07:24:20.867ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84602024-08-16T07:24:20.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
84612024-08-16T07:24:20.868ZINFOnexus (BackgroundTasks): region snapshot replacement start task done background_task = region_snapshot_replacement_start file = nexus/src/app/background/tasks/region_snapshot_replacement_start.rs:252
84622024-08-16T07:24:20.868ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 6.995962ms iteration = 16 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
84632024-08-16T07:24:20.868ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84642024-08-16T07:24:20.868ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
84652024-08-16T07:24:20.868ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1524, tv_nsec: 246304514 } })
84662024-08-16T07:24:20.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84672024-08-16T07:24:20.869ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
84682024-08-16T07:24:20.869ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
84692024-08-16T07:24:20.869ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 8.167769ms iteration = 16 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
84702024-08-16T07:24:20.869ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
84712024-08-16T07:24:20.869ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84722024-08-16T07:24:20.869ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
84732024-08-16T07:24:20.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84742024-08-16T07:24:20.870ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 1 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
84752024-08-16T07:24:20.870ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 9.585542ms iteration = 16 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":1,"total_instances":0,"update_sagas_queued":0}
84762024-08-16T07:24:20.871ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
84772024-08-16T07:24:20.871ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84782024-08-16T07:24:20.871ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
84792024-08-16T07:24:20.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84802024-08-16T07:24:20.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
84812024-08-16T07:24:20.873ZWARNnexus (BackgroundTasks): physical disk adoption task done background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:174
84822024-08-16T07:24:20.873ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 16.690825ms iteration = 18 status = {"physical_disks_added":0}
84832024-08-16T07:24:20.876ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
84842024-08-16T07:24:20.876ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.8002ms iteration = 46 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
84852024-08-16T07:24:20.879ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
84862024-08-16T07:24:20.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
84872024-08-16T07:24:20.879ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
84882024-08-16T07:24:20.880ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84892024-08-16T07:24:20.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84902024-08-16T07:24:20.881ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
84912024-08-16T07:24:20.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84922024-08-16T07:24:20.881ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
84932024-08-16T07:24:20.881ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
84942024-08-16T07:24:20.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
84952024-08-16T07:24:20.882ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84962024-08-16T07:24:20.882ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84972024-08-16T07:24:20.884ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
84982024-08-16T07:24:20.884ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
84992024-08-16T07:24:20.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
85002024-08-16T07:24:20.884ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae, lookup_type: ById(03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae) } result = Ok(())
85012024-08-16T07:24:20.884ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
85022024-08-16T07:24:20.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
85032024-08-16T07:24:20.886ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 24.930646ms iteration = 16 status = 0
85042024-08-16T07:24:21.015ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a zone_address = fd00:1122:3344:101::2
85052024-08-16T07:24:21.015ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
85062024-08-16T07:24:21.016ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a445ac82-3e95-435a-be71-ae3db1d4e5cc", "content-length": "26", "date": "Fri, 16 Aug 2024 07:24:21 GMT"} })
85072024-08-16T07:24:21.016ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
85082024-08-16T07:24:21.017ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
85092024-08-16T07:24:21.027ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
85102024-08-16T07:24:21.027ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "77d2bf66-676f-4efd-9300-110423b01d6f", "content-length": "691", "date": "Fri, 16 Aug 2024 07:24:21 GMT"} })
85112024-08-16T07:24:21.027ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
85122024-08-16T07:24:21.027ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
85132024-08-16T07:24:21.027ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
85142024-08-16T07:24:21.029ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 168.110602ms iteration = 17 status = {}
85152024-08-16T07:24:21.189ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
85162024-08-16T07:24:21.189ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
85172024-08-16T07:24:21.190ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "1a31d5a1-61a6-48ef-bafd-23d2fa7a32b5", "content-length": "26", "date": "Fri, 16 Aug 2024 07:24:21 GMT"} })
85182024-08-16T07:24:21.190ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
85192024-08-16T07:24:21.191ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
85202024-08-16T07:24:21.197ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
85212024-08-16T07:24:21.197ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
85222024-08-16T07:24:21.198ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "2a614230-f9a6-43ea-8065-dcc6c35a958e", "content-length": "26", "date": "Fri, 16 Aug 2024 07:24:21 GMT"} })
85232024-08-16T07:24:21.198ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
85242024-08-16T07:24:21.199ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
85252024-08-16T07:24:21.210ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
85262024-08-16T07:24:21.211ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "646934e8-4ce5-404f-8a07-b690d9759c1a", "content-length": "372", "date": "Fri, 16 Aug 2024 07:24:21 GMT"} })
85272024-08-16T07:24:21.211ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
85282024-08-16T07:24:21.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85292024-08-16T07:24:21.213ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
85302024-08-16T07:24:21.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85312024-08-16T07:24:21.215ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
85322024-08-16T07:24:21.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85332024-08-16T07:24:21.217ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
85342024-08-16T07:24:21.218ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "0a3b711c-5d0c-4459-a1a7-4d9d9e1e60e1", "date": "Fri, 16 Aug 2024 07:24:21 GMT"} })
85352024-08-16T07:24:21.219ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 357.995718ms iteration = 17 status = {}
85362024-08-16T07:24:21.251ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 87633e84-874a-408d-a455-b430952f47e8 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
85372024-08-16T07:24:21.251ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 87633e84-874a-408d-a455-b430952f47e8 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
85382024-08-16T07:24:21.253ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1639 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 87633e84-874a-408d-a455-b430952f47e8 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
85392024-08-16T07:24:21.292ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 436.843049ms iteration = 16 status = {}
85402024-08-16T07:24:21.295ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
85412024-08-16T07:24:21.295ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6fd4f05d-1e31-420d-846f-e6ab1876910b", "content-length": "2", "date": "Fri, 16 Aug 2024 07:24:20 GMT"} })
85422024-08-16T07:24:21.297ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
85432024-08-16T07:24:21.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
85442024-08-16T07:24:21.302ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 447.061795ms iteration = 16 status = null
85452024-08-16T07:24:21.309ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85462024-08-16T07:24:21.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85472024-08-16T07:24:21.311ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:146 port = SwitchPort { id: f13c0939-2c9d-4a0d-b006-5f3de89cc4fc, rack_id: e1b0d583-7b20-4a4b-97f9-9f83300aeb7a, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(4de7fcf8-2b1f-4b0e-ba6f-584e8a34addb) } rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0
85482024-08-16T07:24:21.311ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85492024-08-16T07:24:21.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85502024-08-16T07:24:21.318ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
85512024-08-16T07:24:21.318ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ab7586fa-45d7-4b1a-81f3-02143d2584ed", "content-length": "121", "date": "Fri, 16 Aug 2024 07:24:20 GMT"} })
85522024-08-16T07:24:21.318ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1663 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
85532024-08-16T07:24:21.318ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1690 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 4de7fcf8-2b1f-4b0e-ba6f-584e8a34addb
85542024-08-16T07:24:21.319ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None)}}
85552024-08-16T07:24:21.319ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None)}}
85562024-08-16T07:24:21.319ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {}
85572024-08-16T07:24:21.319ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {}
85582024-08-16T07:24:21.319ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
85592024-08-16T07:24:21.319ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85602024-08-16T07:24:21.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85612024-08-16T07:24:21.320ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
85622024-08-16T07:24:21.320ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "0510642f-95f4-47ca-8012-b6428dd6d52e", "content-length": "2", "date": "Fri, 16 Aug 2024 07:24:20 GMT"} })
85632024-08-16T07:24:21.320ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
85642024-08-16T07:24:21.321ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b33755f4-2d22-4126-b817-08ac6aeb79d5", "content-length": "52", "date": "Fri, 16 Aug 2024 07:24:20 GMT"} })
85652024-08-16T07:24:21.321ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0
85662024-08-16T07:24:21.321ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
85672024-08-16T07:24:21.377ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "aafa829b-c10a-4729-9a2d-963177d02b9c", "date": "Fri, 16 Aug 2024 07:24:21 GMT"} })
85682024-08-16T07:24:21.377ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch = Switch0
85692024-08-16T07:24:21.377ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
85702024-08-16T07:24:21.377ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "8118c835-0f6c-46b0-900a-59d7b9ec3288", "content-length": "494", "date": "Fri, 16 Aug 2024 07:24:21 GMT"} })
85712024-08-16T07:24:21.377ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85722024-08-16T07:24:21.378ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85732024-08-16T07:24:21.379ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85742024-08-16T07:24:21.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85752024-08-16T07:24:21.382ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85762024-08-16T07:24:21.382ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85772024-08-16T07:24:21.383ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85782024-08-16T07:24:21.383ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85792024-08-16T07:24:21.389ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 528.303731ms iteration = 16 status = {}
85802024-08-16T07:24:21.678ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 857 local_addr = [fd00:1122:3344:101::c]:53719 method = GET remote_addr = [fd00:1122:3344:101::d]:60737 req_id = 5eeefcb9-ebc0-4d4b-8543-2d7dfeb37465 response_code = 200 uri = /0d900881-9285-4dbf-910f-5e4676c8f133
85812024-08-16T07:24:22.276ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 6a8156de-10fe-4676-93ad-129ca678fe3a roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
85822024-08-16T07:24:22.276ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 6a8156de-10fe-4676-93ad-129ca678fe3a resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
85832024-08-16T07:24:22.278ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2742 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 6a8156de-10fe-4676-93ad-129ca678fe3a response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
85842024-08-16T07:24:23.297ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 3f7fc900-80a3-49ab-9cf4-cdb352acf37d roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
85852024-08-16T07:24:23.297ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 3f7fc900-80a3-49ab-9cf4-cdb352acf37d resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
85862024-08-16T07:24:23.299ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2884 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 3f7fc900-80a3-49ab-9cf4-cdb352acf37d response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
85872024-08-16T07:24:24.316ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 876da4c0-cd79-4ebf-99eb-02e763643cd1 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
85882024-08-16T07:24:24.317ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 876da4c0-cd79-4ebf-99eb-02e763643cd1 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
85892024-08-16T07:24:24.319ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2324 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 876da4c0-cd79-4ebf-99eb-02e763643cd1 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
85902024-08-16T07:24:25.337ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 765f8966-052c-4913-8303-f754bae62208 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
85912024-08-16T07:24:25.338ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 765f8966-052c-4913-8303-f754bae62208 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
85922024-08-16T07:24:25.339ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1997 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 765f8966-052c-4913-8303-f754bae62208 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
85932024-08-16T07:24:26.360ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 7d714156-f118-4264-add8-79e79f67269b roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
85942024-08-16T07:24:26.360ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 7d714156-f118-4264-add8-79e79f67269b resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
85952024-08-16T07:24:26.362ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1996 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 7d714156-f118-4264-add8-79e79f67269b response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
85962024-08-16T07:24:27.382ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 2b648adf-f031-44c7-b39c-d32925ac4c98 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
85972024-08-16T07:24:27.382ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 2b648adf-f031-44c7-b39c-d32925ac4c98 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
85982024-08-16T07:24:27.384ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2226 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 2b648adf-f031-44c7-b39c-d32925ac4c98 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
85992024-08-16T07:24:28.404ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = a7282378-460f-4915-b6eb-18d1d3076965 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
86002024-08-16T07:24:28.405ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = a7282378-460f-4915-b6eb-18d1d3076965 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
86012024-08-16T07:24:28.406ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2256 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = a7282378-460f-4915-b6eb-18d1d3076965 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
86022024-08-16T07:24:29.427ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 62d88060-b0ca-418e-9e44-3287b577e492 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
86032024-08-16T07:24:29.427ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 62d88060-b0ca-418e-9e44-3287b577e492 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
86042024-08-16T07:24:29.429ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2318 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 62d88060-b0ca-418e-9e44-3287b577e492 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
86052024-08-16T07:24:30.448ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 3cab6630-72a0-4efb-9af8-594bb8d60543 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
86062024-08-16T07:24:30.449ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 3cab6630-72a0-4efb-9af8-594bb8d60543 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
86072024-08-16T07:24:30.451ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2426 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 3cab6630-72a0-4efb-9af8-594bb8d60543 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
86082024-08-16T07:24:30.855ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 47 reason = Timeout
86092024-08-16T07:24:30.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86102024-08-16T07:24:30.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86112024-08-16T07:24:30.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86122024-08-16T07:24:30.859ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
86132024-08-16T07:24:30.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86142024-08-16T07:24:30.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86152024-08-16T07:24:30.860ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86162024-08-16T07:24:30.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86172024-08-16T07:24:30.861ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 47 reason = Timeout
86182024-08-16T07:24:30.861ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
86192024-08-16T07:24:30.861ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
86202024-08-16T07:24:30.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
86212024-08-16T07:24:30.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86222024-08-16T07:24:30.862ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
86232024-08-16T07:24:30.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
86242024-08-16T07:24:30.864ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
86252024-08-16T07:24:30.864ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.229214ms iteration = 47 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
86262024-08-16T07:24:30.864ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
86272024-08-16T07:24:30.864ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86282024-08-16T07:24:30.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86292024-08-16T07:24:30.870ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
86302024-08-16T07:24:30.870ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 15.094219ms iteration = 47 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
86312024-08-16T07:24:31.470ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = d926f27d-507b-4996-8745-b93fcdcc5bdf roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
86322024-08-16T07:24:31.471ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = d926f27d-507b-4996-8745-b93fcdcc5bdf resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
86332024-08-16T07:24:31.472ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1717 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = d926f27d-507b-4996-8745-b93fcdcc5bdf response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
86342024-08-16T07:24:31.679ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 988 local_addr = [fd00:1122:3344:101::c]:53719 method = GET remote_addr = [fd00:1122:3344:101::d]:60737 req_id = 1a8376df-bc66-4945-8ded-31fb78f65100 response_code = 200 uri = /0d900881-9285-4dbf-910f-5e4676c8f133
86352024-08-16T07:24:32.162ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64556 req_id = 0f76ecf9-2a20-4b09-ae2d-f4680b8ba137 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
86362024-08-16T07:24:32.163ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64556 req_id = 0f76ecf9-2a20-4b09-ae2d-f4680b8ba137 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
86372024-08-16T07:24:32.165ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2503 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64556 req_id = 0f76ecf9-2a20-4b09-ae2d-f4680b8ba137 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
86382024-08-16T07:24:32.492ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 13cb7b63-1f86-4961-92eb-96cca01deb5c roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
86392024-08-16T07:24:32.492ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 13cb7b63-1f86-4961-92eb-96cca01deb5c resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
86402024-08-16T07:24:32.494ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2105 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 13cb7b63-1f86-4961-92eb-96cca01deb5c response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
86412024-08-16T07:24:33.514ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 49ce5ca7-2ff3-46fc-a24a-b9495f2d92d1 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
86422024-08-16T07:24:33.514ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 49ce5ca7-2ff3-46fc-a24a-b9495f2d92d1 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
86432024-08-16T07:24:33.516ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1951 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 49ce5ca7-2ff3-46fc-a24a-b9495f2d92d1 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
86442024-08-16T07:24:34.536ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 5c9f9792-7b49-474d-80fb-4a24d20e1c37 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
86452024-08-16T07:24:34.536ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 5c9f9792-7b49-474d-80fb-4a24d20e1c37 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
86462024-08-16T07:24:34.539ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 3180 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 5c9f9792-7b49-474d-80fb-4a24d20e1c37 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
86472024-08-16T07:24:35.559ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = e9f9b63d-9c4d-4e6d-bafa-75ffca6859e4 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
86482024-08-16T07:24:35.559ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = e9f9b63d-9c4d-4e6d-bafa-75ffca6859e4 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
86492024-08-16T07:24:35.561ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2038 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = e9f9b63d-9c4d-4e6d-bafa-75ffca6859e4 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
86502024-08-16T07:24:36.581ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 69a4487e-ec76-46e8-ac61-33f49ca86d38 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
86512024-08-16T07:24:36.582ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 69a4487e-ec76-46e8-ac61-33f49ca86d38 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
86522024-08-16T07:24:36.583ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2338 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 69a4487e-ec76-46e8-ac61-33f49ca86d38 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
86532024-08-16T07:24:37.603ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 392afb71-59e6-496a-9a9d-1b3c629eb989 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
86542024-08-16T07:24:37.603ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 392afb71-59e6-496a-9a9d-1b3c629eb989 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
86552024-08-16T07:24:37.605ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2393 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 392afb71-59e6-496a-9a9d-1b3c629eb989 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
86562024-08-16T07:24:38.625ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = b49e7e58-28a2-4fa0-8914-3cdfa20bb811 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
86572024-08-16T07:24:38.626ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = b49e7e58-28a2-4fa0-8914-3cdfa20bb811 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
86582024-08-16T07:24:38.627ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2669 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = b49e7e58-28a2-4fa0-8914-3cdfa20bb811 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
86592024-08-16T07:24:39.646ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 03534273-d356-4129-969e-f3c612b6338f roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
86602024-08-16T07:24:39.646ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 03534273-d356-4129-969e-f3c612b6338f resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
86612024-08-16T07:24:39.648ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2480 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 03534273-d356-4129-969e-f3c612b6338f response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
86622024-08-16T07:24:40.668ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = de5eeab0-7d91-4bc3-b561-58f9d45626c0 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
86632024-08-16T07:24:40.669ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = de5eeab0-7d91-4bc3-b561-58f9d45626c0 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
86642024-08-16T07:24:40.670ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2190 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = de5eeab0-7d91-4bc3-b561-58f9d45626c0 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
86652024-08-16T07:24:40.855ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 48 reason = Timeout
86662024-08-16T07:24:40.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86672024-08-16T07:24:40.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86682024-08-16T07:24:40.856ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86692024-08-16T07:24:40.858ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
86702024-08-16T07:24:40.858ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86712024-08-16T07:24:40.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86722024-08-16T07:24:40.860ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86732024-08-16T07:24:40.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86742024-08-16T07:24:40.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86752024-08-16T07:24:40.861ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 48 reason = Timeout
86762024-08-16T07:24:40.861ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
86772024-08-16T07:24:40.861ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
86782024-08-16T07:24:40.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
86792024-08-16T07:24:40.862ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
86802024-08-16T07:24:40.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
86812024-08-16T07:24:40.863ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
86822024-08-16T07:24:40.863ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86832024-08-16T07:24:40.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86842024-08-16T07:24:40.864ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
86852024-08-16T07:24:40.864ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 2.949977ms iteration = 48 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
86862024-08-16T07:24:40.869ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
86872024-08-16T07:24:40.869ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 14.039644ms iteration = 48 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
86882024-08-16T07:24:41.680ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1238 local_addr = [fd00:1122:3344:101::c]:53719 method = GET remote_addr = [fd00:1122:3344:101::d]:60737 req_id = 82f67ef9-4f60-4e20-827f-73f2daa32596 response_code = 200 uri = /0d900881-9285-4dbf-910f-5e4676c8f133
86892024-08-16T07:24:41.690ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = fb287a2d-4174-4f48-8d8d-0f975e5376e5 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
86902024-08-16T07:24:41.691ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = fb287a2d-4174-4f48-8d8d-0f975e5376e5 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
86912024-08-16T07:24:41.693ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2298 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = fb287a2d-4174-4f48-8d8d-0f975e5376e5 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
86922024-08-16T07:24:42.712ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = b1835ec4-946f-446f-9e2f-60c82f435b31 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
86932024-08-16T07:24:42.712ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = b1835ec4-946f-446f-9e2f-60c82f435b31 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
86942024-08-16T07:24:42.714ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2143 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = b1835ec4-946f-446f-9e2f-60c82f435b31 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
86952024-08-16T07:24:43.732ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 9a07758a-f2da-406d-a0c9-4bd7bbed053c roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
86962024-08-16T07:24:43.732ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 9a07758a-f2da-406d-a0c9-4bd7bbed053c resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
86972024-08-16T07:24:43.734ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2240 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 9a07758a-f2da-406d-a0c9-4bd7bbed053c response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
86982024-08-16T07:24:44.763ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = ca38f7ec-4a7d-4c12-93b7-326599a6e5b3 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
86992024-08-16T07:24:44.763ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = ca38f7ec-4a7d-4c12-93b7-326599a6e5b3 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
87002024-08-16T07:24:44.765ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1898 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = ca38f7ec-4a7d-4c12-93b7-326599a6e5b3 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
87012024-08-16T07:24:45.788ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = ffa6781d-bf08-49b1-baed-40b03f63e469 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
87022024-08-16T07:24:45.788ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = ffa6781d-bf08-49b1-baed-40b03f63e469 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
87032024-08-16T07:24:45.790ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 3197 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = ffa6781d-bf08-49b1-baed-40b03f63e469 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
87042024-08-16T07:24:46.808ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 15d5c59e-36a1-471b-a06e-6d3c2c78b369 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
87052024-08-16T07:24:46.809ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 15d5c59e-36a1-471b-a06e-6d3c2c78b369 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
87062024-08-16T07:24:46.810ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2162 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 15d5c59e-36a1-471b-a06e-6d3c2c78b369 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
87072024-08-16T07:24:47.830ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 3c2d9390-e0d0-4855-a41f-d8f4b66f2474 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
87082024-08-16T07:24:47.831ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 3c2d9390-e0d0-4855-a41f-d8f4b66f2474 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
87092024-08-16T07:24:47.832ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 3232 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 3c2d9390-e0d0-4855-a41f-d8f4b66f2474 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
87102024-08-16T07:24:48.852ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 010e9b94-22b8-42a8-9848-50c16c23b549 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
87112024-08-16T07:24:48.852ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 010e9b94-22b8-42a8-9848-50c16c23b549 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
87122024-08-16T07:24:48.854ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2178 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 010e9b94-22b8-42a8-9848-50c16c23b549 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
87132024-08-16T07:24:49.873ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 7e69b6bc-834b-4bb1-bc37-e0ae61dfd286 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
87142024-08-16T07:24:49.874ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 7e69b6bc-834b-4bb1-bc37-e0ae61dfd286 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
87152024-08-16T07:24:49.876ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2312 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 7e69b6bc-834b-4bb1-bc37-e0ae61dfd286 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
87162024-08-16T07:24:50.855ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 9 reason = Timeout
87172024-08-16T07:24:50.855ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
87182024-08-16T07:24:50.855ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 49 reason = Timeout
87192024-08-16T07:24:50.855ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
87202024-08-16T07:24:50.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87212024-08-16T07:24:50.855ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 9 reason = Timeout
87222024-08-16T07:24:50.855ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 17 reason = Timeout
87232024-08-16T07:24:50.855ZWARNnexus (BackgroundTasks): phantom disk task started background_task = phantom_disks file = nexus/src/app/background/tasks/phantom_disks.rs:46
87242024-08-16T07:24:50.855ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 17 reason = Timeout
87252024-08-16T07:24:50.855ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
87262024-08-16T07:24:50.855ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 9 reason = Timeout
87272024-08-16T07:24:50.855ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-08-16 07:14:50.855236075 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
87282024-08-16T07:24:50.855ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
87292024-08-16T07:24:50.855ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 9 reason = Timeout
87302024-08-16T07:24:50.855ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 9 reason = Timeout
87312024-08-16T07:24:50.855ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
87322024-08-16T07:24:50.855ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 11 reason = Timeout
87332024-08-16T07:24:50.855ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
87342024-08-16T07:24:50.855ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 17 reason = Timeout
87352024-08-16T07:24:50.855ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
87362024-08-16T07:24:50.855ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 9 reason = Timeout
87372024-08-16T07:24:50.855ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
87382024-08-16T07:24:50.855ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 10 reason = Timeout
87392024-08-16T07:24:50.855ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:69 reason = blueprint disabled target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d
87402024-08-16T07:24:50.855ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 11.871\u{b5}s iteration = 10 status = {"error":"blueprint disabled","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d"}
87412024-08-16T07:24:50.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
87422024-08-16T07:24:50.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87432024-08-16T07:24:50.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
87442024-08-16T07:24:50.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
87452024-08-16T07:24:50.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
87462024-08-16T07:24:50.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
87472024-08-16T07:24:50.855ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 9 reason = Timeout
87482024-08-16T07:24:50.855ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
87492024-08-16T07:24:50.855ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 19 reason = Timeout
87502024-08-16T07:24:50.855ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
87512024-08-16T07:24:50.855ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
87522024-08-16T07:24:50.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
87532024-08-16T07:24:50.856ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6d6264ea-5d56-4938-8c26-581ed0b9907b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a8440aa3-608b-4c08-b70c-6d92a9461396.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("aea2243f-052e-4953-bdfa-7c3368895dd2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("aea2243f-052e-4953-bdfa-7c3368895dd2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1554, tv_nsec: 233465798 } })
87542024-08-16T07:24:50.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
87552024-08-16T07:24:50.856ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("dec19c15-1a2d-47ac-9b9e-9f424d3a3464.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f9649eef-936b-4765-9810-da8662275db5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f9649eef-936b-4765-9810-da8662275db5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1554, tv_nsec: 233626532 } })
87562024-08-16T07:24:50.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
87572024-08-16T07:24:50.857ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
87582024-08-16T07:24:50.857ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
87592024-08-16T07:24:50.857ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 2.58781ms iteration = 9 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
87602024-08-16T07:24:50.857ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 2.656111ms iteration = 9 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
87612024-08-16T07:24:50.858ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87622024-08-16T07:24:50.858ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87632024-08-16T07:24:50.858ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87642024-08-16T07:24:50.858ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
87652024-08-16T07:24:50.858ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-08-16 07:14:50.855236075 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
87662024-08-16T07:24:50.858ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.355817ms iteration = 9 status = {"expiration":"2024-08-16T07:14:50.855236075Z","pruned":[]}
87672024-08-16T07:24:50.858ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
87682024-08-16T07:24:50.858ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1554, tv_nsec: 236344834 } })
87692024-08-16T07:24:50.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
87702024-08-16T07:24:50.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87712024-08-16T07:24:50.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
87722024-08-16T07:24:50.859ZWARNnexus (BackgroundTasks): phantom disk task done background_task = phantom_disks file = nexus/src/app/background/tasks/phantom_disks.rs:93
87732024-08-16T07:24:50.859ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.960031ms iteration = 17 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
87742024-08-16T07:24:50.859ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1554, tv_nsec: 237127533 } })
87752024-08-16T07:24:50.859ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
87762024-08-16T07:24:50.859ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87772024-08-16T07:24:50.860ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87782024-08-16T07:24:50.860ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
87792024-08-16T07:24:50.861ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
87802024-08-16T07:24:50.861ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
87812024-08-16T07:24:50.861ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
87822024-08-16T07:24:50.861ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
87832024-08-16T07:24:50.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
87842024-08-16T07:24:50.861ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 49 reason = Timeout
87852024-08-16T07:24:50.861ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
87862024-08-16T07:24:50.861ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
87872024-08-16T07:24:50.861ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 18 reason = Timeout
87882024-08-16T07:24:50.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
87892024-08-16T07:24:50.861ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
87902024-08-16T07:24:50.861ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 17 reason = Timeout
87912024-08-16T07:24:50.861ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 17 reason = Timeout
87922024-08-16T07:24:50.861ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87932024-08-16T07:24:50.861ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
87942024-08-16T07:24:50.861ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
87952024-08-16T07:24:50.861ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 17 reason = Timeout
87962024-08-16T07:24:50.861ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
87972024-08-16T07:24:50.861ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
87982024-08-16T07:24:50.861ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
87992024-08-16T07:24:50.861ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 17 reason = Timeout
88002024-08-16T07:24:50.861ZWARNnexus (BackgroundTasks): region replacement task started background_task = region_replacement file = nexus/src/app/background/tasks/region_replacement.rs:64
88012024-08-16T07:24:50.861ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
88022024-08-16T07:24:50.861ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 17 reason = Timeout
88032024-08-16T07:24:50.861ZINFOnexus (BackgroundTasks): region snapshot replacement garbage collect task started background_task = region_snapshot_replacement_garbage_collection file = nexus/src/app/background/tasks/region_snapshot_replacement_garbage_collect.rs:133
88042024-08-16T07:24:50.861ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
88052024-08-16T07:24:50.861ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 11 reason = Timeout
88062024-08-16T07:24:50.861ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 9 reason = Timeout
88072024-08-16T07:24:50.861ZINFOnexus (BackgroundTasks): lookup region port task started background_task = lookup_region_port file = nexus/src/app/background/tasks/lookup_region_port.rs:56
88082024-08-16T07:24:50.861ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
88092024-08-16T07:24:50.861ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 9 reason = Timeout
88102024-08-16T07:24:50.861ZINFOnexus (BackgroundTasks): Abandoned VMM reaper running background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:76
88112024-08-16T07:24:50.861ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
88122024-08-16T07:24:50.861ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 18 reason = Timeout
88132024-08-16T07:24:50.861ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
88142024-08-16T07:24:50.861ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 17 reason = Timeout
88152024-08-16T07:24:50.861ZINFOnexus (BackgroundTasks): region snapshot replacement start task started background_task = region_snapshot_replacement_start file = nexus/src/app/background/tasks/region_snapshot_replacement_start.rs:236
88162024-08-16T07:24:50.861ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
88172024-08-16T07:24:50.862ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 17 reason = Timeout
88182024-08-16T07:24:50.862ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
88192024-08-16T07:24:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
88202024-08-16T07:24:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88212024-08-16T07:24:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
88222024-08-16T07:24:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
88232024-08-16T07:24:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
88242024-08-16T07:24:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
88252024-08-16T07:24:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
88262024-08-16T07:24:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
88272024-08-16T07:24:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
88282024-08-16T07:24:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
88292024-08-16T07:24:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
88302024-08-16T07:24:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
88312024-08-16T07:24:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
88322024-08-16T07:24:50.862ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
88332024-08-16T07:24:50.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
88342024-08-16T07:24:50.863ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88352024-08-16T07:24:50.863ZINFOnexus (BackgroundTasks): region snapshot replacement garbage collect task done background_task = region_snapshot_replacement_garbage_collection file = nexus/src/app/background/tasks/region_snapshot_replacement_garbage_collect.rs:147
88362024-08-16T07:24:50.863ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 1.960146ms iteration = 17 status = {"errors":[],"garbage_collect_requested":[]}
88372024-08-16T07:24:50.864ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
88382024-08-16T07:24:50.864ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88392024-08-16T07:24:50.864ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88402024-08-16T07:24:50.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88412024-08-16T07:24:50.864ZWARNnexus (BackgroundTasks): physical disk adoption task started background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:100
88422024-08-16T07:24:50.864ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
88432024-08-16T07:24:50.864ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
88442024-08-16T07:24:50.864ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
88452024-08-16T07:24:50.864ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 8.940817ms iteration = 9 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
88462024-08-16T07:24:50.864ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
88472024-08-16T07:24:50.864ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88482024-08-16T07:24:50.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
88492024-08-16T07:24:50.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
88502024-08-16T07:24:50.865ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
88512024-08-16T07:24:50.865ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
88522024-08-16T07:24:50.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88532024-08-16T07:24:50.865ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88542024-08-16T07:24:50.865ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
88552024-08-16T07:24:50.865ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88562024-08-16T07:24:50.865ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88572024-08-16T07:24:50.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88582024-08-16T07:24:50.865ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
88592024-08-16T07:24:50.865ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
88602024-08-16T07:24:50.865ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
88612024-08-16T07:24:50.865ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
88622024-08-16T07:24:50.866ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
88632024-08-16T07:24:50.866ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
88642024-08-16T07:24:50.866ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
88652024-08-16T07:24:50.866ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
88662024-08-16T07:24:50.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
88672024-08-16T07:24:50.866ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
88682024-08-16T07:24:50.866ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.478533ms iteration = 49 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
88692024-08-16T07:24:50.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
88702024-08-16T07:24:50.867ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88712024-08-16T07:24:50.867ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88722024-08-16T07:24:50.867ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1554, tv_nsec: 244947043 } })
88732024-08-16T07:24:50.867ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88742024-08-16T07:24:50.867ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
88752024-08-16T07:24:50.867ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
88762024-08-16T07:24:50.867ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 5.806685ms iteration = 9 status = {"error":null,"error_count":0,"found":0,"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0}
88772024-08-16T07:24:50.867ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88782024-08-16T07:24:50.868ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
88792024-08-16T07:24:50.868ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
88802024-08-16T07:24:50.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
88812024-08-16T07:24:50.868ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
88822024-08-16T07:24:50.868ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
88832024-08-16T07:24:50.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
88842024-08-16T07:24:50.868ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
88852024-08-16T07:24:50.868ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
88862024-08-16T07:24:50.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
88872024-08-16T07:24:50.869ZINFOnexus (BackgroundTasks): region snapshot replacement start task done background_task = region_snapshot_replacement_start file = nexus/src/app/background/tasks/region_snapshot_replacement_start.rs:252
88882024-08-16T07:24:50.869ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 7.987625ms iteration = 17 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
88892024-08-16T07:24:50.869ZINFOnexus (BackgroundTasks): lookup region port task done background_task = lookup_region_port file = nexus/src/app/background/tasks/lookup_region_port.rs:150
88902024-08-16T07:24:50.870ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 8.108427ms iteration = 9 status = {"errors":[],"found_port_ok":[]}
88912024-08-16T07:24:50.870ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88922024-08-16T07:24:50.870ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
88932024-08-16T07:24:50.870ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
88942024-08-16T07:24:50.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
88952024-08-16T07:24:50.870ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
88962024-08-16T07:24:50.870ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
88972024-08-16T07:24:50.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
88982024-08-16T07:24:50.871ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
88992024-08-16T07:24:50.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
89002024-08-16T07:24:50.871ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
89012024-08-16T07:24:50.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
89022024-08-16T07:24:50.871ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
89032024-08-16T07:24:50.871ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
89042024-08-16T07:24:50.871ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
89052024-08-16T07:24:50.871ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
89062024-08-16T07:24:50.872ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
89072024-08-16T07:24:50.872ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
89082024-08-16T07:24:50.872ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
89092024-08-16T07:24:50.872ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89102024-08-16T07:24:50.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
89112024-08-16T07:24:50.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
89122024-08-16T07:24:50.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
89132024-08-16T07:24:50.872ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
89142024-08-16T07:24:50.872ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
89152024-08-16T07:24:50.872ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89162024-08-16T07:24:50.872ZWARNnexus (BackgroundTasks): region replacement task done background_task = region_replacement file = nexus/src/app/background/tasks/region_replacement.rs:185
89172024-08-16T07:24:50.872ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 10.868701ms iteration = 17 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
89182024-08-16T07:24:50.872ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89192024-08-16T07:24:50.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
89202024-08-16T07:24:50.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89212024-08-16T07:24:50.873ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
89222024-08-16T07:24:50.873ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
89232024-08-16T07:24:50.873ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
89242024-08-16T07:24:50.873ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
89252024-08-16T07:24:50.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
89262024-08-16T07:24:50.873ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 11.935576ms iteration = 17 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
89272024-08-16T07:24:50.873ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
89282024-08-16T07:24:50.873ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = ddebb22e-3faa-4936-9b3e-0f4d28827c0e dns_zone_name = oxide.test found_so_far = 0 version = 2
89292024-08-16T07:24:50.873ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
89302024-08-16T07:24:50.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
89312024-08-16T07:24:50.874ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
89322024-08-16T07:24:50.874ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 2c55b660-f328-498e-b44c-73da75015ed4 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
89332024-08-16T07:24:50.874ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
89342024-08-16T07:24:50.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
89352024-08-16T07:24:50.874ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
89362024-08-16T07:24:50.874ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89372024-08-16T07:24:50.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89382024-08-16T07:24:50.874ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
89392024-08-16T07:24:50.874ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 12.957659ms iteration = 17 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
89402024-08-16T07:24:50.875ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
89412024-08-16T07:24:50.875ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
89422024-08-16T07:24:50.875ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89432024-08-16T07:24:50.875ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89442024-08-16T07:24:50.875ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
89452024-08-16T07:24:50.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
89462024-08-16T07:24:50.875ZWARNnexus (BackgroundTasks): physical disk adoption task done background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:174
89472024-08-16T07:24:50.875ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 19.689704ms iteration = 19 status = {"physical_disks_added":0}
89482024-08-16T07:24:50.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
89492024-08-16T07:24:50.878ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
89502024-08-16T07:24:50.878ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
89512024-08-16T07:24:50.878ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
89522024-08-16T07:24:50.878ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
89532024-08-16T07:24:50.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
89542024-08-16T07:24:50.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
89552024-08-16T07:24:50.878ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
89562024-08-16T07:24:50.878ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.746718ms iteration = 49 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
89572024-08-16T07:24:50.880ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = ddebb22e-3faa-4936-9b3e-0f4d28827c0e dns_zone_name = oxide.test found_so_far = 1 version = 2
89582024-08-16T07:24:50.880ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
89592024-08-16T07:24:50.880ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-08-16 07:16:55.724690 UTC dns_group = external generation = 2
89602024-08-16T07:24:50.880ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 24.951177ms iteration = 9 status = {"generation":2}
89612024-08-16T07:24:50.880ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 2c55b660-f328-498e-b44c-73da75015ed4 dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
89622024-08-16T07:24:50.880ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
89632024-08-16T07:24:50.880ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-08-16 07:16:55.302318 UTC dns_group = internal generation = 1
89642024-08-16T07:24:50.880ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 25.457078ms iteration = 9 status = {"generation":1}
89652024-08-16T07:24:50.880ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
89662024-08-16T07:24:50.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
89672024-08-16T07:24:50.881ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89682024-08-16T07:24:50.883ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
89692024-08-16T07:24:50.883ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
89702024-08-16T07:24:50.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
89712024-08-16T07:24:50.884ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89722024-08-16T07:24:50.885ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-08-16T07:16:49.943339Z, time_modified: 2024-08-16T07:16:49.943339Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, db_silo: Silo { identity: SiloIdentity { id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-16T07:16:55.682566Z, time_modified: 2024-08-16T07:16:55.682566Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "c9e400628d2b58a74b998fbfa44a053952e83a6e8d3c49e6518981bf7d4a006f" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, db_silo: Silo { identity: SiloIdentity { id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-16T07:16:55.682566Z, time_modified: 2024-08-16T07:16:55.682566Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "c9e400628d2b58a74b998fbfa44a053952e83a6e8d3c49e6518981bf7d4a006f" }] }) }
89732024-08-16T07:24:50.885ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 30.033643ms iteration = 9 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071","tls_certs":["c9e400628d2b58a74b998fbfa44a053952e83a6e8d3c49e6518981bf7d4a006f"]}},"default_endpoint":{"silo_id":"439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071","tls_certs":["c9e400628d2b58a74b998fbfa44a053952e83a6e8d3c49e6518981bf7d4a006f"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
89742024-08-16T07:24:50.885ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
89752024-08-16T07:24:50.885ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
89762024-08-16T07:24:50.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
89772024-08-16T07:24:50.890ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
89782024-08-16T07:24:50.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
89792024-08-16T07:24:50.892ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
89802024-08-16T07:24:50.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
89812024-08-16T07:24:50.893ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89822024-08-16T07:24:50.895ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = aa3d7e63-f9ce-4d41-b2cd-09f8c53d84ae roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
89832024-08-16T07:24:50.895ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = aa3d7e63-f9ce-4d41-b2cd-09f8c53d84ae resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
89842024-08-16T07:24:50.895ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae, lookup_type: ById(03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae) } result = Ok(())
89852024-08-16T07:24:50.895ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
89862024-08-16T07:24:50.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
89872024-08-16T07:24:50.896ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 34.601099ms iteration = 17 status = 0
89882024-08-16T07:24:50.896ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1648 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = aa3d7e63-f9ce-4d41-b2cd-09f8c53d84ae response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
89892024-08-16T07:24:51.008ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
89902024-08-16T07:24:51.008ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
89912024-08-16T07:24:51.008ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ec2e42b3-4640-4eef-ac0c-e50c99cc4619", "content-length": "26", "date": "Fri, 16 Aug 2024 07:24:51 GMT"} })
89922024-08-16T07:24:51.009ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
89932024-08-16T07:24:51.010ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
89942024-08-16T07:24:51.086ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
89952024-08-16T07:24:51.086ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
89962024-08-16T07:24:51.087ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "59c95a82-3408-41f5-a045-170570d985f8", "content-length": "26", "date": "Fri, 16 Aug 2024 07:24:51 GMT"} })
89972024-08-16T07:24:51.087ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
89982024-08-16T07:24:51.089ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
89992024-08-16T07:24:51.100ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
90002024-08-16T07:24:51.101ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ecc810bb-2a3b-4331-9f7b-4a3a2414e18a", "content-length": "372", "date": "Fri, 16 Aug 2024 07:24:51 GMT"} })
90012024-08-16T07:24:51.101ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90022024-08-16T07:24:51.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90032024-08-16T07:24:51.103ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90042024-08-16T07:24:51.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90052024-08-16T07:24:51.105ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90062024-08-16T07:24:51.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90072024-08-16T07:24:51.107ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
90082024-08-16T07:24:51.108ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "b1998136-e84f-4775-80b1-0f01a6b87e1f", "date": "Fri, 16 Aug 2024 07:24:51 GMT"} })
90092024-08-16T07:24:51.109ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 247.129407ms iteration = 18 status = {}
90102024-08-16T07:24:51.124ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
90112024-08-16T07:24:51.212ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
90122024-08-16T07:24:51.213ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a zone_address = fd00:1122:3344:101::2
90132024-08-16T07:24:51.213ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
90142024-08-16T07:24:51.213ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "00bfd900-deb6-4268-a935-092fe048b765", "content-length": "2", "date": "Fri, 16 Aug 2024 07:24:50 GMT"} })
90152024-08-16T07:24:51.213ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f4d4cee6-24be-42b6-b7e2-cedb44c43354", "content-length": "26", "date": "Fri, 16 Aug 2024 07:24:51 GMT"} })
90162024-08-16T07:24:51.213ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
90172024-08-16T07:24:51.213ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
90182024-08-16T07:24:51.214ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "7ad58757-e62a-425d-87de-c48c567b5c64", "content-length": "691", "date": "Fri, 16 Aug 2024 07:24:51 GMT"} })
90192024-08-16T07:24:51.214ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
90202024-08-16T07:24:51.214ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
90212024-08-16T07:24:51.214ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
90222024-08-16T07:24:51.218ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
90232024-08-16T07:24:51.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
90242024-08-16T07:24:51.218ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
90252024-08-16T07:24:51.219ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
90262024-08-16T07:24:51.219ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 357.593559ms iteration = 18 status = {}
90272024-08-16T07:24:51.219ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 364.615591ms iteration = 17 status = null
90282024-08-16T07:24:51.253ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 397.923371ms iteration = 17 status = {}
90292024-08-16T07:24:51.356ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
90302024-08-16T07:24:51.409ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
90312024-08-16T07:24:51.410ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "a4a71851-6a21-46d0-a54a-51f817b204db", "date": "Fri, 16 Aug 2024 07:24:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
90322024-08-16T07:24:51.410ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
90332024-08-16T07:24:51.412ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "d25fc212-9537-4ef1-b59e-a6c8944c5a80", "date": "Fri, 16 Aug 2024 07:24:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
90342024-08-16T07:24:51.412ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
90352024-08-16T07:24:51.413ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
90362024-08-16T07:24:51.413ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 551.960107ms iteration = 11 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
90372024-08-16T07:24:51.462ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
90382024-08-16T07:24:51.463ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "31ed5aa3-df47-4c73-852e-2089673b3b02", "date": "Fri, 16 Aug 2024 07:24:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
90392024-08-16T07:24:51.463ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
90402024-08-16T07:24:51.464ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "048e25e5-dd0f-451b-8b78-63d363ef36ca", "date": "Fri, 16 Aug 2024 07:24:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
90412024-08-16T07:24:51.464ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
90422024-08-16T07:24:51.466ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "9cca456b-8e98-452d-b721-5b56186e31ca", "date": "Fri, 16 Aug 2024 07:24:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
90432024-08-16T07:24:51.466ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
90442024-08-16T07:24:51.468ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
90452024-08-16T07:24:51.468ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 613.463687ms iteration = 11 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
90462024-08-16T07:24:51.475ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90472024-08-16T07:24:51.475ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90482024-08-16T07:24:51.477ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:146 port = SwitchPort { id: f13c0939-2c9d-4a0d-b006-5f3de89cc4fc, rack_id: e1b0d583-7b20-4a4b-97f9-9f83300aeb7a, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(4de7fcf8-2b1f-4b0e-ba6f-584e8a34addb) } rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0
90492024-08-16T07:24:51.477ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90502024-08-16T07:24:51.477ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90512024-08-16T07:24:51.485ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
90522024-08-16T07:24:51.487ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "0f547d76-580b-41f5-a8ce-fb1d40517b46", "content-length": "121", "date": "Fri, 16 Aug 2024 07:24:50 GMT"} })
90532024-08-16T07:24:51.487ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1663 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
90542024-08-16T07:24:51.487ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1690 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 4de7fcf8-2b1f-4b0e-ba6f-584e8a34addb
90552024-08-16T07:24:51.487ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None)}}
90562024-08-16T07:24:51.487ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None)}}
90572024-08-16T07:24:51.487ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {}
90582024-08-16T07:24:51.487ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {}
90592024-08-16T07:24:51.487ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
90602024-08-16T07:24:51.487ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90612024-08-16T07:24:51.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90622024-08-16T07:24:51.489ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
90632024-08-16T07:24:51.489ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "1f696615-bb95-4f02-82d1-bdb50609a9b8", "content-length": "2", "date": "Fri, 16 Aug 2024 07:24:50 GMT"} })
90642024-08-16T07:24:51.489ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
90652024-08-16T07:24:51.489ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "bc22be0f-ece3-4157-b55d-65d3ca15d06e", "content-length": "52", "date": "Fri, 16 Aug 2024 07:24:50 GMT"} })
90662024-08-16T07:24:51.489ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0
90672024-08-16T07:24:51.489ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
90682024-08-16T07:24:51.543ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "453ce297-aa46-4629-b324-9b9285ca18d5", "date": "Fri, 16 Aug 2024 07:24:51 GMT"} })
90692024-08-16T07:24:51.543ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch = Switch0
90702024-08-16T07:24:51.543ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
90712024-08-16T07:24:51.543ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "4be0490e-8cb7-40f6-8426-14f56d9e263b", "content-length": "494", "date": "Fri, 16 Aug 2024 07:24:51 GMT"} })
90722024-08-16T07:24:51.543ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90732024-08-16T07:24:51.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90742024-08-16T07:24:51.545ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90752024-08-16T07:24:51.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90762024-08-16T07:24:51.548ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90772024-08-16T07:24:51.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90782024-08-16T07:24:51.549ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90792024-08-16T07:24:51.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90802024-08-16T07:24:51.557ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 695.38636ms iteration = 17 status = {}
90812024-08-16T07:24:51.679ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 827 local_addr = [fd00:1122:3344:101::c]:53719 method = GET remote_addr = [fd00:1122:3344:101::d]:60737 req_id = b18096df-3d40-492f-a253-b2c5e6be5d92 response_code = 200 uri = /0d900881-9285-4dbf-910f-5e4676c8f133
90822024-08-16T07:24:51.917ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 2184fcb6-355f-4e2f-9504-7fc6f39fa508 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
90832024-08-16T07:24:51.917ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 2184fcb6-355f-4e2f-9504-7fc6f39fa508 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
90842024-08-16T07:24:51.918ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1765 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 2184fcb6-355f-4e2f-9504-7fc6f39fa508 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
90852024-08-16T07:24:52.938ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 4d117b61-d2d1-42d6-bdd4-700d4e54db8e roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
90862024-08-16T07:24:52.939ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 4d117b61-d2d1-42d6-bdd4-700d4e54db8e resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
90872024-08-16T07:24:52.940ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2447 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 4d117b61-d2d1-42d6-bdd4-700d4e54db8e response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
90882024-08-16T07:24:53.959ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 4022584a-8172-4fc4-b553-4816be0c84b3 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
90892024-08-16T07:24:53.960ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 4022584a-8172-4fc4-b553-4816be0c84b3 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
90902024-08-16T07:24:53.961ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2264 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 4022584a-8172-4fc4-b553-4816be0c84b3 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
90912024-08-16T07:24:54.981ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 4f315492-6174-4682-ac35-e8d7f282a90a roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
90922024-08-16T07:24:54.981ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 4f315492-6174-4682-ac35-e8d7f282a90a resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
90932024-08-16T07:24:54.983ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2377 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 4f315492-6174-4682-ac35-e8d7f282a90a response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
90942024-08-16T07:24:56.003ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = a843a4b1-e01b-4b5b-b6fe-0086d1d1b23c roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
90952024-08-16T07:24:56.003ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = a843a4b1-e01b-4b5b-b6fe-0086d1d1b23c resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
90962024-08-16T07:24:56.005ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2065 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = a843a4b1-e01b-4b5b-b6fe-0086d1d1b23c response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
90972024-08-16T07:24:57.026ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 162cb5a7-7ee5-4f86-9ac0-c62c46e2666a roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
90982024-08-16T07:24:57.026ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 162cb5a7-7ee5-4f86-9ac0-c62c46e2666a resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
90992024-08-16T07:24:57.028ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2464 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 162cb5a7-7ee5-4f86-9ac0-c62c46e2666a response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
91002024-08-16T07:24:58.048ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 0caa66e5-8484-41ac-9667-2f82013f2f3c roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
91012024-08-16T07:24:58.048ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 0caa66e5-8484-41ac-9667-2f82013f2f3c resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
91022024-08-16T07:24:58.050ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2728 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 0caa66e5-8484-41ac-9667-2f82013f2f3c response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
91032024-08-16T07:24:59.071ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = c54048fd-8840-4475-9adb-a42f09212aa6 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
91042024-08-16T07:24:59.071ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = c54048fd-8840-4475-9adb-a42f09212aa6 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
91052024-08-16T07:24:59.073ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2610 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = c54048fd-8840-4475-9adb-a42f09212aa6 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
91062024-08-16T07:25:00.092ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 1bcfe52b-1093-43bc-a7c3-237ba162b78f roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
91072024-08-16T07:25:00.092ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 1bcfe52b-1093-43bc-a7c3-237ba162b78f resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
91082024-08-16T07:25:00.093ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1854 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 1bcfe52b-1093-43bc-a7c3-237ba162b78f response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
91092024-08-16T07:25:00.856ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 50 reason = Timeout
91102024-08-16T07:25:00.856ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91112024-08-16T07:25:00.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91122024-08-16T07:25:00.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91132024-08-16T07:25:00.860ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
91142024-08-16T07:25:00.860ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91152024-08-16T07:25:00.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91162024-08-16T07:25:00.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91172024-08-16T07:25:00.861ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 50 reason = Timeout
91182024-08-16T07:25:00.861ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
91192024-08-16T07:25:00.861ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
91202024-08-16T07:25:00.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91212024-08-16T07:25:00.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
91222024-08-16T07:25:00.863ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91232024-08-16T07:25:00.863ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
91242024-08-16T07:25:00.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
91252024-08-16T07:25:00.865ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
91262024-08-16T07:25:00.865ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.249795ms iteration = 50 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
91272024-08-16T07:25:00.865ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
91282024-08-16T07:25:00.865ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91292024-08-16T07:25:00.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91302024-08-16T07:25:00.871ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
91312024-08-16T07:25:00.871ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 15.634631ms iteration = 50 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
91322024-08-16T07:25:01.115ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 05de99e4-7135-4365-99c1-83406fbc01c4 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
91332024-08-16T07:25:01.115ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 05de99e4-7135-4365-99c1-83406fbc01c4 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
91342024-08-16T07:25:01.117ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1639 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 05de99e4-7135-4365-99c1-83406fbc01c4 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
91352024-08-16T07:25:01.680ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1607 local_addr = [fd00:1122:3344:101::c]:53719 method = GET remote_addr = [fd00:1122:3344:101::d]:60737 req_id = b93cc97a-1d6d-4cee-aa19-84b4d2d3a688 response_code = 200 uri = /0d900881-9285-4dbf-910f-5e4676c8f133
91362024-08-16T07:25:02.136ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 021a36be-1d33-4160-92a5-542b87edfe3e roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
91372024-08-16T07:25:02.137ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 021a36be-1d33-4160-92a5-542b87edfe3e resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
91382024-08-16T07:25:02.138ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2244 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 021a36be-1d33-4160-92a5-542b87edfe3e response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
91392024-08-16T07:25:02.195ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64556 req_id = 4eadc9c3-85c6-40ef-a9e4-e8433c171605 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
91402024-08-16T07:25:02.195ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64556 req_id = 4eadc9c3-85c6-40ef-a9e4-e8433c171605 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
91412024-08-16T07:25:02.197ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2296 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64556 req_id = 4eadc9c3-85c6-40ef-a9e4-e8433c171605 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
91422024-08-16T07:25:03.158ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = de886d2f-a898-4284-a048-ba33a7abf00d roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
91432024-08-16T07:25:03.158ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = de886d2f-a898-4284-a048-ba33a7abf00d resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
91442024-08-16T07:25:03.160ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2725 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = de886d2f-a898-4284-a048-ba33a7abf00d response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
91452024-08-16T07:25:04.180ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 4dfe6f91-6e7a-4a6a-be2a-0b6b55d1dcba roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
91462024-08-16T07:25:04.181ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 4dfe6f91-6e7a-4a6a-be2a-0b6b55d1dcba resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
91472024-08-16T07:25:04.182ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2114 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 4dfe6f91-6e7a-4a6a-be2a-0b6b55d1dcba response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
91482024-08-16T07:25:05.201ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 2af1f072-6d97-492e-addc-a17eb013a17d roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
91492024-08-16T07:25:05.201ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 2af1f072-6d97-492e-addc-a17eb013a17d resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
91502024-08-16T07:25:05.203ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2090 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 2af1f072-6d97-492e-addc-a17eb013a17d response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
91512024-08-16T07:25:06.221ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 0d88dbed-7720-4ff3-bba5-9b87d3074f8d roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
91522024-08-16T07:25:06.221ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 0d88dbed-7720-4ff3-bba5-9b87d3074f8d resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
91532024-08-16T07:25:06.223ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2488 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 0d88dbed-7720-4ff3-bba5-9b87d3074f8d response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
91542024-08-16T07:25:07.243ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 1832728f-46de-40dd-bbd0-d81ac51c47de roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
91552024-08-16T07:25:07.244ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 1832728f-46de-40dd-bbd0-d81ac51c47de resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
91562024-08-16T07:25:07.245ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2444 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 1832728f-46de-40dd-bbd0-d81ac51c47de response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
91572024-08-16T07:25:08.267ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 52c857b5-ce68-41cb-97d4-96d1afc8e297 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
91582024-08-16T07:25:08.267ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 52c857b5-ce68-41cb-97d4-96d1afc8e297 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
91592024-08-16T07:25:08.269ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2611 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 52c857b5-ce68-41cb-97d4-96d1afc8e297 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
91602024-08-16T07:25:09.288ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 21d45209-8b6a-4ff2-a16b-d1744b1fa528 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
91612024-08-16T07:25:09.288ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 21d45209-8b6a-4ff2-a16b-d1744b1fa528 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
91622024-08-16T07:25:09.290ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2319 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 21d45209-8b6a-4ff2-a16b-d1744b1fa528 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
91632024-08-16T07:25:10.310ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = fe8e4662-dfbc-4d84-b398-2f08486f4f27 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
91642024-08-16T07:25:10.311ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = fe8e4662-dfbc-4d84-b398-2f08486f4f27 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
91652024-08-16T07:25:10.312ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2325 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = fe8e4662-dfbc-4d84-b398-2f08486f4f27 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
91662024-08-16T07:25:10.856ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 51 reason = Timeout
91672024-08-16T07:25:10.856ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91682024-08-16T07:25:10.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91692024-08-16T07:25:10.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91702024-08-16T07:25:10.860ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
91712024-08-16T07:25:10.860ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91722024-08-16T07:25:10.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91732024-08-16T07:25:10.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91742024-08-16T07:25:10.861ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 51 reason = Timeout
91752024-08-16T07:25:10.861ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
91762024-08-16T07:25:10.861ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
91772024-08-16T07:25:10.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91782024-08-16T07:25:10.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
91792024-08-16T07:25:10.863ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91802024-08-16T07:25:10.863ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
91812024-08-16T07:25:10.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
91822024-08-16T07:25:10.864ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
91832024-08-16T07:25:10.864ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.402648ms iteration = 51 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
91842024-08-16T07:25:10.865ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
91852024-08-16T07:25:10.865ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91862024-08-16T07:25:10.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91872024-08-16T07:25:10.871ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
91882024-08-16T07:25:10.871ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 15.368595ms iteration = 51 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
91892024-08-16T07:25:11.332ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 138ad094-1b71-44b0-9876-5a8ad271fd8f roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
91902024-08-16T07:25:11.333ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 138ad094-1b71-44b0-9876-5a8ad271fd8f resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
91912024-08-16T07:25:11.334ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2167 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 138ad094-1b71-44b0-9876-5a8ad271fd8f response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
91922024-08-16T07:25:11.679ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 927 local_addr = [fd00:1122:3344:101::c]:53719 method = GET remote_addr = [fd00:1122:3344:101::d]:60737 req_id = 60771b2c-f1c0-4bd4-9378-9dd0ca703ecc response_code = 200 uri = /0d900881-9285-4dbf-910f-5e4676c8f133
91932024-08-16T07:25:12.354ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 7a55f595-92e1-4ac4-a401-eaf214789fd4 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
91942024-08-16T07:25:12.354ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 7a55f595-92e1-4ac4-a401-eaf214789fd4 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
91952024-08-16T07:25:12.356ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2209 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 7a55f595-92e1-4ac4-a401-eaf214789fd4 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
91962024-08-16T07:25:13.376ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 4f719138-f8f3-4e2a-a15b-c53564c81daf roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
91972024-08-16T07:25:13.376ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 4f719138-f8f3-4e2a-a15b-c53564c81daf resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
91982024-08-16T07:25:13.378ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2543 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 4f719138-f8f3-4e2a-a15b-c53564c81daf response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
91992024-08-16T07:25:14.396ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = e798ca6f-1e7b-4054-a668-4dc282d63e09 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
92002024-08-16T07:25:14.396ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = e798ca6f-1e7b-4054-a668-4dc282d63e09 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
92012024-08-16T07:25:14.398ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2558 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = e798ca6f-1e7b-4054-a668-4dc282d63e09 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
92022024-08-16T07:25:15.419ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 3e6237e1-dac3-469c-8198-291427290b8b roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
92032024-08-16T07:25:15.420ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 3e6237e1-dac3-469c-8198-291427290b8b resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
92042024-08-16T07:25:15.422ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2447 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 3e6237e1-dac3-469c-8198-291427290b8b response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
92052024-08-16T07:25:16.443ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = b6f9bd76-f0de-4347-bbb2-cbe47916cbb3 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
92062024-08-16T07:25:16.443ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = b6f9bd76-f0de-4347-bbb2-cbe47916cbb3 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
92072024-08-16T07:25:16.445ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2621 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = b6f9bd76-f0de-4347-bbb2-cbe47916cbb3 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
92082024-08-16T07:25:17.464ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = fa338058-52d3-421f-ab49-7cb9604def74 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
92092024-08-16T07:25:17.464ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = fa338058-52d3-421f-ab49-7cb9604def74 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
92102024-08-16T07:25:17.466ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2021 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = fa338058-52d3-421f-ab49-7cb9604def74 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
92112024-08-16T07:25:18.486ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 6d9c2a64-83df-4fe8-84e4-a68eff6c3ec3 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
92122024-08-16T07:25:18.486ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 6d9c2a64-83df-4fe8-84e4-a68eff6c3ec3 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
92132024-08-16T07:25:18.488ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 3134 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 6d9c2a64-83df-4fe8-84e4-a68eff6c3ec3 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
92142024-08-16T07:25:19.506ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 526bb6c2-ba26-49ce-8086-2ed4b1c7a2be roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
92152024-08-16T07:25:19.506ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 526bb6c2-ba26-49ce-8086-2ed4b1c7a2be resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
92162024-08-16T07:25:19.508ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1954 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 526bb6c2-ba26-49ce-8086-2ed4b1c7a2be response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
92172024-08-16T07:25:20.528ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 10f97641-4c9c-42cf-967c-fedcb0106fb8 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
92182024-08-16T07:25:20.529ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 10f97641-4c9c-42cf-967c-fedcb0106fb8 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
92192024-08-16T07:25:20.530ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2708 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 10f97641-4c9c-42cf-967c-fedcb0106fb8 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
92202024-08-16T07:25:20.856ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 18 reason = Timeout
92212024-08-16T07:25:20.856ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 18 reason = Timeout
92222024-08-16T07:25:20.856ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
92232024-08-16T07:25:20.856ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
92242024-08-16T07:25:20.856ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 52 reason = Timeout
92252024-08-16T07:25:20.856ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 18 reason = Timeout
92262024-08-16T07:25:20.856ZWARNnexus (BackgroundTasks): phantom disk task started background_task = phantom_disks file = nexus/src/app/background/tasks/phantom_disks.rs:46
92272024-08-16T07:25:20.856ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92282024-08-16T07:25:20.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
92292024-08-16T07:25:20.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
92302024-08-16T07:25:20.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92312024-08-16T07:25:20.857ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 20 reason = Timeout
92322024-08-16T07:25:20.857ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
92332024-08-16T07:25:20.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
92342024-08-16T07:25:20.858ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92352024-08-16T07:25:20.858ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92362024-08-16T07:25:20.859ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1584, tv_nsec: 236361427 } })
92372024-08-16T07:25:20.859ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1584, tv_nsec: 236532091 } })
92382024-08-16T07:25:20.859ZWARNnexus (BackgroundTasks): phantom disk task done background_task = phantom_disks file = nexus/src/app/background/tasks/phantom_disks.rs:93
92392024-08-16T07:25:20.859ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.517661ms iteration = 18 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
92402024-08-16T07:25:20.859ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
92412024-08-16T07:25:20.860ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
92422024-08-16T07:25:20.860ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
92432024-08-16T07:25:20.860ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
92442024-08-16T07:25:20.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
92452024-08-16T07:25:20.860ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
92462024-08-16T07:25:20.860ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92472024-08-16T07:25:20.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92482024-08-16T07:25:20.861ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 18 reason = Timeout
92492024-08-16T07:25:20.861ZINFOnexus (BackgroundTasks): region snapshot replacement start task started background_task = region_snapshot_replacement_start file = nexus/src/app/background/tasks/region_snapshot_replacement_start.rs:236
92502024-08-16T07:25:20.861ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 19 reason = Timeout
92512024-08-16T07:25:20.861ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
92522024-08-16T07:25:20.861ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
92532024-08-16T07:25:20.861ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 52 reason = Timeout
92542024-08-16T07:25:20.861ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
92552024-08-16T07:25:20.861ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
92562024-08-16T07:25:20.861ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 18 reason = Timeout
92572024-08-16T07:25:20.861ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 18 reason = Timeout
92582024-08-16T07:25:20.861ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
92592024-08-16T07:25:20.861ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
92602024-08-16T07:25:20.861ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 19 reason = Timeout
92612024-08-16T07:25:20.861ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 18 reason = Timeout
92622024-08-16T07:25:20.861ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
92632024-08-16T07:25:20.861ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
92642024-08-16T07:25:20.861ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
92652024-08-16T07:25:20.861ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 18 reason = Timeout
92662024-08-16T07:25:20.861ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
92672024-08-16T07:25:20.861ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 18 reason = Timeout
92682024-08-16T07:25:20.861ZWARNnexus (BackgroundTasks): region replacement task started background_task = region_replacement file = nexus/src/app/background/tasks/region_replacement.rs:64
92692024-08-16T07:25:20.861ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
92702024-08-16T07:25:20.861ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 18 reason = Timeout
92712024-08-16T07:25:20.861ZINFOnexus (BackgroundTasks): region snapshot replacement garbage collect task started background_task = region_snapshot_replacement_garbage_collection file = nexus/src/app/background/tasks/region_snapshot_replacement_garbage_collect.rs:133
92722024-08-16T07:25:20.861ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
92732024-08-16T07:25:20.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
92742024-08-16T07:25:20.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
92752024-08-16T07:25:20.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
92762024-08-16T07:25:20.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
92772024-08-16T07:25:20.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
92782024-08-16T07:25:20.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
92792024-08-16T07:25:20.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
92802024-08-16T07:25:20.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
92812024-08-16T07:25:20.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
92822024-08-16T07:25:20.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92832024-08-16T07:25:20.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
92842024-08-16T07:25:20.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92852024-08-16T07:25:20.862ZWARNnexus (BackgroundTasks): physical disk adoption task started background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:100
92862024-08-16T07:25:20.862ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
92872024-08-16T07:25:20.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
92882024-08-16T07:25:20.862ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92892024-08-16T07:25:20.862ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92902024-08-16T07:25:20.863ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92912024-08-16T07:25:20.863ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92922024-08-16T07:25:20.864ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
92932024-08-16T07:25:20.864ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
92942024-08-16T07:25:20.864ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
92952024-08-16T07:25:20.864ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
92962024-08-16T07:25:20.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
92972024-08-16T07:25:20.865ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
92982024-08-16T07:25:20.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
92992024-08-16T07:25:20.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
93002024-08-16T07:25:20.865ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
93012024-08-16T07:25:20.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
93022024-08-16T07:25:20.865ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
93032024-08-16T07:25:20.865ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93042024-08-16T07:25:20.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93052024-08-16T07:25:20.866ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
93062024-08-16T07:25:20.866ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.811642ms iteration = 52 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
93072024-08-16T07:25:20.866ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
93082024-08-16T07:25:20.866ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
93092024-08-16T07:25:20.866ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
93102024-08-16T07:25:20.866ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93112024-08-16T07:25:20.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
93122024-08-16T07:25:20.866ZINFOnexus (BackgroundTasks): region snapshot replacement start task done background_task = region_snapshot_replacement_start file = nexus/src/app/background/tasks/region_snapshot_replacement_start.rs:252
93132024-08-16T07:25:20.866ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 5.16986ms iteration = 18 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
93142024-08-16T07:25:20.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93152024-08-16T07:25:20.866ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
93162024-08-16T07:25:20.866ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
93172024-08-16T07:25:20.866ZWARNnexus (BackgroundTasks): region replacement task done background_task = region_replacement file = nexus/src/app/background/tasks/region_replacement.rs:185
93182024-08-16T07:25:20.866ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 5.446896ms iteration = 18 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
93192024-08-16T07:25:20.866ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
93202024-08-16T07:25:20.866ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
93212024-08-16T07:25:20.866ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 5.507117ms iteration = 18 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
93222024-08-16T07:25:20.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
93232024-08-16T07:25:20.867ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93242024-08-16T07:25:20.867ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93252024-08-16T07:25:20.867ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1584, tv_nsec: 244652218 } })
93262024-08-16T07:25:20.868ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93272024-08-16T07:25:20.868ZINFOnexus (BackgroundTasks): region snapshot replacement garbage collect task done background_task = region_snapshot_replacement_garbage_collection file = nexus/src/app/background/tasks/region_snapshot_replacement_garbage_collect.rs:147
93282024-08-16T07:25:20.868ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 6.973901ms iteration = 18 status = {"errors":[],"garbage_collect_requested":[]}
93292024-08-16T07:25:20.868ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
93302024-08-16T07:25:20.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93312024-08-16T07:25:20.869ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
93322024-08-16T07:25:20.869ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93332024-08-16T07:25:20.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93342024-08-16T07:25:20.870ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
93352024-08-16T07:25:20.870ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93362024-08-16T07:25:20.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93372024-08-16T07:25:20.870ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93382024-08-16T07:25:20.872ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
93392024-08-16T07:25:20.872ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93402024-08-16T07:25:20.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93412024-08-16T07:25:20.873ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
93422024-08-16T07:25:20.873ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 12.372916ms iteration = 18 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
93432024-08-16T07:25:20.873ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
93442024-08-16T07:25:20.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
93452024-08-16T07:25:20.874ZWARNnexus (BackgroundTasks): physical disk adoption task done background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:174
93462024-08-16T07:25:20.874ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 17.590776ms iteration = 20 status = {"physical_disks_added":0}
93472024-08-16T07:25:20.875ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
93482024-08-16T07:25:20.875ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.735806ms iteration = 52 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
93492024-08-16T07:25:20.879ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93502024-08-16T07:25:20.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93512024-08-16T07:25:20.881ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
93522024-08-16T07:25:20.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
93532024-08-16T07:25:20.881ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93542024-08-16T07:25:20.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93552024-08-16T07:25:20.882ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93562024-08-16T07:25:20.882ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93572024-08-16T07:25:20.884ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
93582024-08-16T07:25:20.884ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
93592024-08-16T07:25:20.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
93602024-08-16T07:25:20.885ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93612024-08-16T07:25:20.885ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae, lookup_type: ById(03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae) } result = Ok(())
93622024-08-16T07:25:20.885ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93632024-08-16T07:25:20.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93642024-08-16T07:25:20.886ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 25.09781ms iteration = 18 status = 0
93652024-08-16T07:25:20.886ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
93662024-08-16T07:25:20.886ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
93672024-08-16T07:25:20.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
93682024-08-16T07:25:20.966ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
93692024-08-16T07:25:20.966ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
93702024-08-16T07:25:20.966ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6325a648-9a7e-4e40-9b26-a63947d701b9", "content-length": "26", "date": "Fri, 16 Aug 2024 07:25:20 GMT"} })
93712024-08-16T07:25:20.966ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
93722024-08-16T07:25:20.968ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
93732024-08-16T07:25:20.977ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
93742024-08-16T07:25:20.977ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
93752024-08-16T07:25:20.978ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "08438ffb-ad67-4ae3-a38b-1a0765ddf786", "content-length": "26", "date": "Fri, 16 Aug 2024 07:25:20 GMT"} })
93762024-08-16T07:25:20.978ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
93772024-08-16T07:25:20.980ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
93782024-08-16T07:25:20.991ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a zone_address = fd00:1122:3344:101::2
93792024-08-16T07:25:20.991ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
93802024-08-16T07:25:20.991ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "7716b4c7-8ab3-4fa6-ac0b-f819aec86cb8", "content-length": "26", "date": "Fri, 16 Aug 2024 07:25:20 GMT"} })
93812024-08-16T07:25:20.991ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
93822024-08-16T07:25:20.992ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
93832024-08-16T07:25:20.996ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
93842024-08-16T07:25:20.996ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b68b76ff-65fd-4494-8663-203f2609f063", "content-length": "372", "date": "Fri, 16 Aug 2024 07:25:20 GMT"} })
93852024-08-16T07:25:20.996ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93862024-08-16T07:25:20.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93872024-08-16T07:25:20.998ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93882024-08-16T07:25:20.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93892024-08-16T07:25:21.001ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93902024-08-16T07:25:21.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93912024-08-16T07:25:21.003ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
93922024-08-16T07:25:21.003ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "280907ee-e427-47d3-ab4b-d514f85849c3", "date": "Fri, 16 Aug 2024 07:25:20 GMT"} })
93932024-08-16T07:25:21.004ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 143.549025ms iteration = 19 status = {}
93942024-08-16T07:25:21.095ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
93952024-08-16T07:25:21.095ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "76924a56-034d-46dd-8948-24c2b4152f25", "content-length": "691", "date": "Fri, 16 Aug 2024 07:25:20 GMT"} })
93962024-08-16T07:25:21.095ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
93972024-08-16T07:25:21.095ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
93982024-08-16T07:25:21.096ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
93992024-08-16T07:25:21.096ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 235.52798ms iteration = 19 status = {}
94002024-08-16T07:25:21.201ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 345.831647ms iteration = 18 status = {}
94012024-08-16T07:25:21.212ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
94022024-08-16T07:25:21.212ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "26b18ddb-15c0-43e0-b04e-674542b0bf25", "content-length": "2", "date": "Fri, 16 Aug 2024 07:25:20 GMT"} })
94032024-08-16T07:25:21.213ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
94042024-08-16T07:25:21.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
94052024-08-16T07:25:21.215ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 359.151995ms iteration = 18 status = null
94062024-08-16T07:25:21.230ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94072024-08-16T07:25:21.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94082024-08-16T07:25:21.232ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:146 port = SwitchPort { id: f13c0939-2c9d-4a0d-b006-5f3de89cc4fc, rack_id: e1b0d583-7b20-4a4b-97f9-9f83300aeb7a, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(4de7fcf8-2b1f-4b0e-ba6f-584e8a34addb) } rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0
94092024-08-16T07:25:21.232ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94102024-08-16T07:25:21.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94112024-08-16T07:25:21.238ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
94122024-08-16T07:25:21.239ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "2331e2be-4269-4c76-90e6-f31c19a4a652", "content-length": "121", "date": "Fri, 16 Aug 2024 07:25:20 GMT"} })
94132024-08-16T07:25:21.239ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1663 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
94142024-08-16T07:25:21.239ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1690 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 4de7fcf8-2b1f-4b0e-ba6f-584e8a34addb
94152024-08-16T07:25:21.239ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None)}}
94162024-08-16T07:25:21.239ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None)}}
94172024-08-16T07:25:21.239ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {}
94182024-08-16T07:25:21.239ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {}
94192024-08-16T07:25:21.239ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
94202024-08-16T07:25:21.239ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94212024-08-16T07:25:21.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94222024-08-16T07:25:21.241ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
94232024-08-16T07:25:21.241ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "bb1e0341-0b49-434f-8b6d-a3ec709b93ce", "content-length": "2", "date": "Fri, 16 Aug 2024 07:25:20 GMT"} })
94242024-08-16T07:25:21.241ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
94252024-08-16T07:25:21.241ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e1d37973-f25a-43d8-9aa6-8ea319295ae1", "content-length": "52", "date": "Fri, 16 Aug 2024 07:25:20 GMT"} })
94262024-08-16T07:25:21.241ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0
94272024-08-16T07:25:21.241ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
94282024-08-16T07:25:21.295ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "aff5215c-2e9f-44f5-b919-d28b5e11865d", "date": "Fri, 16 Aug 2024 07:25:20 GMT"} })
94292024-08-16T07:25:21.295ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch = Switch0
94302024-08-16T07:25:21.295ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
94312024-08-16T07:25:21.295ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6da79abf-4e72-4e83-9e6c-39a7e5803c22", "content-length": "494", "date": "Fri, 16 Aug 2024 07:25:20 GMT"} })
94322024-08-16T07:25:21.295ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94332024-08-16T07:25:21.296ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94342024-08-16T07:25:21.298ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94352024-08-16T07:25:21.298ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94362024-08-16T07:25:21.300ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94372024-08-16T07:25:21.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94382024-08-16T07:25:21.301ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94392024-08-16T07:25:21.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94402024-08-16T07:25:21.309ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 447.70951ms iteration = 18 status = {}
94412024-08-16T07:25:21.551ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 5544485f-f6cc-4781-a93a-9463a5c67cbe roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
94422024-08-16T07:25:21.551ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 5544485f-f6cc-4781-a93a-9463a5c67cbe resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
94432024-08-16T07:25:21.553ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1914 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 5544485f-f6cc-4781-a93a-9463a5c67cbe response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
94442024-08-16T07:25:21.679ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 676 local_addr = [fd00:1122:3344:101::c]:53719 method = GET remote_addr = [fd00:1122:3344:101::d]:60737 req_id = 376ea808-8b2a-402a-ab6b-08cb39a27709 response_code = 200 uri = /0d900881-9285-4dbf-910f-5e4676c8f133
94452024-08-16T07:25:21.681ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
94462024-08-16T07:25:21.681ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
94472024-08-16T07:25:21.711ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
94482024-08-16T07:25:21.711ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:62360
94492024-08-16T07:25:21.711ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:62360 req_id = 5498083e-de32-4181-b457-2fbe9c2952d5 roles = RoleSet { roles: {} } uri = /metrics/producers
94502024-08-16T07:25:21.712ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:62360 req_id = 5498083e-de32-4181-b457-2fbe9c2952d5 resource = Database result = Ok(()) uri = /metrics/producers
94512024-08-16T07:25:21.744ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 62147b68-6c5f-49df-a144-ebe1b87f0e27
94522024-08-16T07:25:21.744ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:62360 req_id = 5498083e-de32-4181-b457-2fbe9c2952d5 roles = RoleSet { roles: {} } uri = /metrics/producers
94532024-08-16T07:25:21.744ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:62360 req_id = 5498083e-de32-4181-b457-2fbe9c2952d5 resource = Database result = Ok(()) uri = /metrics/producers
94542024-08-16T07:25:21.775ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 62147b68-6c5f-49df-a144-ebe1b87f0e27 uri = http://[fd00:1122:3344:101::d]:12223/producers
94552024-08-16T07:25:21.776ZDEBGnexus: client response oximeter-collector = 62147b68-6c5f-49df-a144-ebe1b87f0e27 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "c22cce34-e84e-4459-b4fd-817c945e3075", "date": "Fri, 16 Aug 2024 07:25:21 GMT"} })
94562024-08-16T07:25:21.776ZINFOnexus: assigned collector to new producer collector_id = 62147b68-6c5f-49df-a144-ebe1b87f0e27 file = nexus/src/app/oximeter.rs:125 producer_id = 0d900881-9285-4dbf-910f-5e4676c8f133
94572024-08-16T07:25:21.778ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 66823 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:62360 req_id = 5498083e-de32-4181-b457-2fbe9c2952d5 response_code = 201 uri = /metrics/producers
94582024-08-16T07:25:21.778ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::c)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, status: 201, headers: {"content-type": "application/json", "x-request-id": "5498083e-de32-4181-b457-2fbe9c2952d5", "content-length": "41", "date": "Fri, 16 Aug 2024 07:25:21 GMT"} })
94592024-08-16T07:25:21.779ZDEBGnexus (producer-registration-task): registered with nexus successfully
94602024-08-16T07:25:21.779ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
94612024-08-16T07:25:22.573ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = b841c7a5-638f-4e2f-b756-e8f96a4a24f1 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
94622024-08-16T07:25:22.573ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = b841c7a5-638f-4e2f-b756-e8f96a4a24f1 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
94632024-08-16T07:25:22.575ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2384 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = b841c7a5-638f-4e2f-b756-e8f96a4a24f1 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
94642024-08-16T07:25:23.594ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 9c7601c5-1d9d-4743-987a-09dd77182260 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
94652024-08-16T07:25:23.594ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 9c7601c5-1d9d-4743-987a-09dd77182260 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
94662024-08-16T07:25:23.596ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2095 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 9c7601c5-1d9d-4743-987a-09dd77182260 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
94672024-08-16T07:25:24.615ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = fe39cd04-ed2d-48b2-a842-b530d22e9ccc roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
94682024-08-16T07:25:24.615ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = fe39cd04-ed2d-48b2-a842-b530d22e9ccc resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
94692024-08-16T07:25:24.617ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2381 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = fe39cd04-ed2d-48b2-a842-b530d22e9ccc response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
94702024-08-16T07:25:25.637ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 155c68fb-97d3-459e-8eb3-2c3ae12a7bbf roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
94712024-08-16T07:25:25.638ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 155c68fb-97d3-459e-8eb3-2c3ae12a7bbf resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
94722024-08-16T07:25:25.639ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2190 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 155c68fb-97d3-459e-8eb3-2c3ae12a7bbf response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
94732024-08-16T07:25:26.659ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = cf4dad73-cce0-4ca9-8600-a3f00570a581 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
94742024-08-16T07:25:26.660ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = cf4dad73-cce0-4ca9-8600-a3f00570a581 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
94752024-08-16T07:25:26.662ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2402 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = cf4dad73-cce0-4ca9-8600-a3f00570a581 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
94762024-08-16T07:25:27.681ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 9612a2b4-b60a-461b-a71f-58ea3e2660c2 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
94772024-08-16T07:25:27.681ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 9612a2b4-b60a-461b-a71f-58ea3e2660c2 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
94782024-08-16T07:25:27.683ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2430 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 9612a2b4-b60a-461b-a71f-58ea3e2660c2 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
94792024-08-16T07:25:28.703ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 6d1a56a0-430e-465e-84c0-6234812c9f52 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
94802024-08-16T07:25:28.703ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 6d1a56a0-430e-465e-84c0-6234812c9f52 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
94812024-08-16T07:25:28.705ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2494 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 6d1a56a0-430e-465e-84c0-6234812c9f52 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
94822024-08-16T07:25:29.725ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = e0ecd560-8bf2-444e-8981-d06e8ac1099f roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
94832024-08-16T07:25:29.725ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = e0ecd560-8bf2-444e-8981-d06e8ac1099f resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
94842024-08-16T07:25:29.727ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2328 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = e0ecd560-8bf2-444e-8981-d06e8ac1099f response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
94852024-08-16T07:25:30.747ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = bdfaffed-3b42-4fbd-ad7f-e0cd6d3634db roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
94862024-08-16T07:25:30.747ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = bdfaffed-3b42-4fbd-ad7f-e0cd6d3634db resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
94872024-08-16T07:25:30.749ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2437 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = bdfaffed-3b42-4fbd-ad7f-e0cd6d3634db response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
94882024-08-16T07:25:30.855ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 53 reason = Timeout
94892024-08-16T07:25:30.856ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94902024-08-16T07:25:30.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94912024-08-16T07:25:30.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94922024-08-16T07:25:30.860ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
94932024-08-16T07:25:30.860ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94942024-08-16T07:25:30.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94952024-08-16T07:25:30.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94962024-08-16T07:25:30.861ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 53 reason = Timeout
94972024-08-16T07:25:30.861ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
94982024-08-16T07:25:30.861ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
94992024-08-16T07:25:30.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95002024-08-16T07:25:30.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
95012024-08-16T07:25:30.862ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95022024-08-16T07:25:30.863ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
95032024-08-16T07:25:30.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
95042024-08-16T07:25:30.864ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
95052024-08-16T07:25:30.864ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.01876ms iteration = 53 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
95062024-08-16T07:25:30.865ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
95072024-08-16T07:25:30.865ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95082024-08-16T07:25:30.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95092024-08-16T07:25:30.871ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
95102024-08-16T07:25:30.871ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 15.217331ms iteration = 53 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
95112024-08-16T07:25:31.228ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64556 req_id = be549009-fa5a-43c3-859f-f9510a36c8fd roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
95122024-08-16T07:25:31.229ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64556 req_id = be549009-fa5a-43c3-859f-f9510a36c8fd resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
95132024-08-16T07:25:31.231ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2620 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64556 req_id = be549009-fa5a-43c3-859f-f9510a36c8fd response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
95142024-08-16T07:25:31.769ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = cbfc5869-6a93-4955-9df4-dc05ff2fd04b roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
95152024-08-16T07:25:31.770ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = cbfc5869-6a93-4955-9df4-dc05ff2fd04b resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
95162024-08-16T07:25:31.771ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2124 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = cbfc5869-6a93-4955-9df4-dc05ff2fd04b response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
95172024-08-16T07:25:31.777ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 840 local_addr = [fd00:1122:3344:101::c]:53719 method = GET remote_addr = [fd00:1122:3344:101::d]:60737 req_id = 5980cefe-6437-4179-8ebe-7f443126cb6b response_code = 200 uri = /0d900881-9285-4dbf-910f-5e4676c8f133
95182024-08-16T07:25:32.793ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 91c8d2d5-aa37-4969-b014-66eccfe01aad roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
95192024-08-16T07:25:32.793ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 91c8d2d5-aa37-4969-b014-66eccfe01aad resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
95202024-08-16T07:25:32.795ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 3157 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 91c8d2d5-aa37-4969-b014-66eccfe01aad response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
95212024-08-16T07:25:33.815ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 0fdf1f95-86fc-41f9-a3a0-a64ba1abf367 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
95222024-08-16T07:25:33.815ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 0fdf1f95-86fc-41f9-a3a0-a64ba1abf367 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
95232024-08-16T07:25:33.817ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2113 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 0fdf1f95-86fc-41f9-a3a0-a64ba1abf367 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
95242024-08-16T07:25:34.836ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = bb1fd8ef-5ae9-4782-89fc-043947299348 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
95252024-08-16T07:25:34.837ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = bb1fd8ef-5ae9-4782-89fc-043947299348 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
95262024-08-16T07:25:34.839ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2330 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = bb1fd8ef-5ae9-4782-89fc-043947299348 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
95272024-08-16T07:25:35.857ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 5560c686-13ae-4d1e-bac6-fb271b035ff4 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
95282024-08-16T07:25:35.858ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 5560c686-13ae-4d1e-bac6-fb271b035ff4 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
95292024-08-16T07:25:35.860ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2507 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 5560c686-13ae-4d1e-bac6-fb271b035ff4 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
95302024-08-16T07:25:36.880ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 8ab417f3-5eec-4f38-8a6e-bcfd6b2f518c roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
95312024-08-16T07:25:36.881ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 8ab417f3-5eec-4f38-8a6e-bcfd6b2f518c resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
95322024-08-16T07:25:36.883ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2329 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 8ab417f3-5eec-4f38-8a6e-bcfd6b2f518c response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
95332024-08-16T07:25:37.902ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = ce288f0d-d744-4e65-8967-8f607ca6026c roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
95342024-08-16T07:25:37.903ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = ce288f0d-d744-4e65-8967-8f607ca6026c resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
95352024-08-16T07:25:37.904ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2187 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = ce288f0d-d744-4e65-8967-8f607ca6026c response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
95362024-08-16T07:25:38.924ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 17cc9a71-82ad-4488-bfd1-e27b8de750d3 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
95372024-08-16T07:25:38.925ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 17cc9a71-82ad-4488-bfd1-e27b8de750d3 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
95382024-08-16T07:25:38.927ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2434 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 17cc9a71-82ad-4488-bfd1-e27b8de750d3 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
95392024-08-16T07:25:39.947ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 53c51b76-da10-4629-a7ef-0c24dc337310 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
95402024-08-16T07:25:39.947ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 53c51b76-da10-4629-a7ef-0c24dc337310 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
95412024-08-16T07:25:39.949ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2520 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 53c51b76-da10-4629-a7ef-0c24dc337310 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
95422024-08-16T07:25:40.856ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 54 reason = Timeout
95432024-08-16T07:25:40.856ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95442024-08-16T07:25:40.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95452024-08-16T07:25:40.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95462024-08-16T07:25:40.860ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
95472024-08-16T07:25:40.860ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95482024-08-16T07:25:40.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95492024-08-16T07:25:40.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95502024-08-16T07:25:40.861ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 54 reason = Timeout
95512024-08-16T07:25:40.861ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
95522024-08-16T07:25:40.861ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
95532024-08-16T07:25:40.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95542024-08-16T07:25:40.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
95552024-08-16T07:25:40.863ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95562024-08-16T07:25:40.863ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
95572024-08-16T07:25:40.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
95582024-08-16T07:25:40.865ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
95592024-08-16T07:25:40.865ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.585953ms iteration = 54 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
95602024-08-16T07:25:40.865ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
95612024-08-16T07:25:40.865ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95622024-08-16T07:25:40.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95632024-08-16T07:25:40.871ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
95642024-08-16T07:25:40.871ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 15.650751ms iteration = 54 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
95652024-08-16T07:25:40.968ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 95bba727-ff91-4af9-9014-b48e5514310b roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
95662024-08-16T07:25:40.968ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 95bba727-ff91-4af9-9014-b48e5514310b resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
95672024-08-16T07:25:40.973ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 4591 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 95bba727-ff91-4af9-9014-b48e5514310b response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
95682024-08-16T07:25:41.777ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 711 local_addr = [fd00:1122:3344:101::c]:53719 method = GET remote_addr = [fd00:1122:3344:101::d]:60737 req_id = 351a176d-8626-4bc0-9c6b-a16231d26b9b response_code = 200 uri = /0d900881-9285-4dbf-910f-5e4676c8f133
95692024-08-16T07:25:41.994ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 8de4eabc-c421-4e8a-a78a-d02735aafcae roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
95702024-08-16T07:25:41.995ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 8de4eabc-c421-4e8a-a78a-d02735aafcae resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
95712024-08-16T07:25:41.996ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1901 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 8de4eabc-c421-4e8a-a78a-d02735aafcae response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
95722024-08-16T07:25:43.014ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 7657a02b-a7a7-4d6d-b05b-336e6118c5e2 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
95732024-08-16T07:25:43.014ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 7657a02b-a7a7-4d6d-b05b-336e6118c5e2 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
95742024-08-16T07:25:43.016ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2450 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 7657a02b-a7a7-4d6d-b05b-336e6118c5e2 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
95752024-08-16T07:25:44.036ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = c9f04c59-b91d-4a96-87a1-d29dde4a6d6c roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
95762024-08-16T07:25:44.037ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = c9f04c59-b91d-4a96-87a1-d29dde4a6d6c resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
95772024-08-16T07:25:44.039ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2355 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = c9f04c59-b91d-4a96-87a1-d29dde4a6d6c response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
95782024-08-16T07:25:45.059ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 850ab601-0ac6-4309-a47c-7e6a48d1e88e roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
95792024-08-16T07:25:45.059ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 850ab601-0ac6-4309-a47c-7e6a48d1e88e resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
95802024-08-16T07:25:45.061ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2396 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 850ab601-0ac6-4309-a47c-7e6a48d1e88e response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
95812024-08-16T07:25:46.082ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = afd5f973-3368-4d34-8495-acef8ba0fa81 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
95822024-08-16T07:25:46.082ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = afd5f973-3368-4d34-8495-acef8ba0fa81 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
95832024-08-16T07:25:46.084ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2426 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = afd5f973-3368-4d34-8495-acef8ba0fa81 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
95842024-08-16T07:25:47.103ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = e68d7532-357b-45a2-9fcc-5af153520f4c roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
95852024-08-16T07:25:47.104ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = e68d7532-357b-45a2-9fcc-5af153520f4c resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
95862024-08-16T07:25:47.105ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2230 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = e68d7532-357b-45a2-9fcc-5af153520f4c response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
95872024-08-16T07:25:48.125ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = aadc61a4-9eaa-4df5-8a86-ad9b5c35466a roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
95882024-08-16T07:25:48.126ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = aadc61a4-9eaa-4df5-8a86-ad9b5c35466a resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
95892024-08-16T07:25:48.128ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2492 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = aadc61a4-9eaa-4df5-8a86-ad9b5c35466a response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
95902024-08-16T07:25:49.148ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 97dc999f-bcb2-4850-a6a1-a2b7fe27536c roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
95912024-08-16T07:25:49.149ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 97dc999f-bcb2-4850-a6a1-a2b7fe27536c resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
95922024-08-16T07:25:49.150ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2169 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 97dc999f-bcb2-4850-a6a1-a2b7fe27536c response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
95932024-08-16T07:25:50.171ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = ce8b72f3-1653-47cd-bf55-fb78b788cc06 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
95942024-08-16T07:25:50.171ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = ce8b72f3-1653-47cd-bf55-fb78b788cc06 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
95952024-08-16T07:25:50.173ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2444 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = ce8b72f3-1653-47cd-bf55-fb78b788cc06 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
95962024-08-16T07:25:50.855ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 10 reason = Timeout
95972024-08-16T07:25:50.855ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
95982024-08-16T07:25:50.855ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 55 reason = Timeout
95992024-08-16T07:25:50.855ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
96002024-08-16T07:25:50.855ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 10 reason = Timeout
96012024-08-16T07:25:50.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96022024-08-16T07:25:50.855ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 19 reason = Timeout
96032024-08-16T07:25:50.855ZWARNnexus (BackgroundTasks): phantom disk task started background_task = phantom_disks file = nexus/src/app/background/tasks/phantom_disks.rs:46
96042024-08-16T07:25:50.855ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 19 reason = Timeout
96052024-08-16T07:25:50.855ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 10 reason = Timeout
96062024-08-16T07:25:50.855ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
96072024-08-16T07:25:50.855ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-08-16 07:15:50.855775847 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
96082024-08-16T07:25:50.855ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 12 reason = Timeout
96092024-08-16T07:25:50.855ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
96102024-08-16T07:25:50.855ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 19 reason = Timeout
96112024-08-16T07:25:50.855ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
96122024-08-16T07:25:50.855ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 11 reason = Timeout
96132024-08-16T07:25:50.855ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 10 reason = Timeout
96142024-08-16T07:25:50.855ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:69 reason = blueprint disabled target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d
96152024-08-16T07:25:50.856ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
96162024-08-16T07:25:50.856ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
96172024-08-16T07:25:50.856ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 15.271\u{b5}s iteration = 11 status = {"error":"blueprint disabled","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d"}
96182024-08-16T07:25:50.856ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 10 reason = Timeout
96192024-08-16T07:25:50.856ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 10 reason = Timeout
96202024-08-16T07:25:50.856ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
96212024-08-16T07:25:50.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
96222024-08-16T07:25:50.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96232024-08-16T07:25:50.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
96242024-08-16T07:25:50.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
96252024-08-16T07:25:50.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
96262024-08-16T07:25:50.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
96272024-08-16T07:25:50.856ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 5 reason = Timeout
96282024-08-16T07:25:50.856ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 21 reason = Timeout
96292024-08-16T07:25:50.856ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
96302024-08-16T07:25:50.856ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 10 reason = Timeout
96312024-08-16T07:25:50.856ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
96322024-08-16T07:25:50.856ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
96332024-08-16T07:25:50.856ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
96342024-08-16T07:25:50.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
96352024-08-16T07:25:50.856ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6d6264ea-5d56-4938-8c26-581ed0b9907b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a8440aa3-608b-4c08-b70c-6d92a9461396.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("aea2243f-052e-4953-bdfa-7c3368895dd2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("aea2243f-052e-4953-bdfa-7c3368895dd2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1614, tv_nsec: 233618084 } })
96362024-08-16T07:25:50.856ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
96372024-08-16T07:25:50.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
96382024-08-16T07:25:50.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
96392024-08-16T07:25:50.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
96402024-08-16T07:25:50.856ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
96412024-08-16T07:25:50.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
96422024-08-16T07:25:50.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
96432024-08-16T07:25:50.857ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
96442024-08-16T07:25:50.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
96452024-08-16T07:25:50.857ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
96462024-08-16T07:25:50.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
96472024-08-16T07:25:50.857ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
96482024-08-16T07:25:50.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
96492024-08-16T07:25:50.857ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("dec19c15-1a2d-47ac-9b9e-9f424d3a3464.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f9649eef-936b-4765-9810-da8662275db5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f9649eef-936b-4765-9810-da8662275db5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1614, tv_nsec: 234677159 } })
96502024-08-16T07:25:50.858ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
96512024-08-16T07:25:50.858ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96522024-08-16T07:25:50.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
96532024-08-16T07:25:50.858ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96542024-08-16T07:25:50.859ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96552024-08-16T07:25:50.859ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
96562024-08-16T07:25:50.859ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 3.639534ms iteration = 10 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
96572024-08-16T07:25:50.859ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1614, tv_nsec: 236410519 } })
96582024-08-16T07:25:50.859ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
96592024-08-16T07:25:50.859ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 3.562743ms iteration = 10 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
96602024-08-16T07:25:50.859ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-08-16 07:15:50.855775847 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
96612024-08-16T07:25:50.859ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.862639ms iteration = 10 status = {"expiration":"2024-08-16T07:15:50.855775847Z","pruned":[]}
96622024-08-16T07:25:50.859ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96632024-08-16T07:25:50.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96642024-08-16T07:25:50.860ZWARNnexus (BackgroundTasks): phantom disk task done background_task = phantom_disks file = nexus/src/app/background/tasks/phantom_disks.rs:93
96652024-08-16T07:25:50.860ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.576456ms iteration = 19 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
96662024-08-16T07:25:50.860ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
96672024-08-16T07:25:50.861ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1614, tv_nsec: 238026566 } })
96682024-08-16T07:25:50.861ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 20 reason = Timeout
96692024-08-16T07:25:50.861ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 20 reason = Timeout
96702024-08-16T07:25:50.861ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
96712024-08-16T07:25:50.861ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 19 reason = Timeout
96722024-08-16T07:25:50.861ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
96732024-08-16T07:25:50.861ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 10 reason = Timeout
96742024-08-16T07:25:50.861ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
96752024-08-16T07:25:50.861ZINFOnexus (BackgroundTasks): Abandoned VMM reaper running background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:76
96762024-08-16T07:25:50.861ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
96772024-08-16T07:25:50.861ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 10 reason = Timeout
96782024-08-16T07:25:50.861ZINFOnexus (BackgroundTasks): lookup region port task started background_task = lookup_region_port file = nexus/src/app/background/tasks/lookup_region_port.rs:56
96792024-08-16T07:25:50.861ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 12 reason = Timeout
96802024-08-16T07:25:50.861ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
96812024-08-16T07:25:50.861ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 55 reason = Timeout
96822024-08-16T07:25:50.861ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
96832024-08-16T07:25:50.861ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
96842024-08-16T07:25:50.861ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 19 reason = Timeout
96852024-08-16T07:25:50.861ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
96862024-08-16T07:25:50.861ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 19 reason = Timeout
96872024-08-16T07:25:50.861ZINFOnexus (BackgroundTasks): region snapshot replacement start task started background_task = region_snapshot_replacement_start file = nexus/src/app/background/tasks/region_snapshot_replacement_start.rs:236
96882024-08-16T07:25:50.861ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
96892024-08-16T07:25:50.861ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 19 reason = Timeout
96902024-08-16T07:25:50.861ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
96912024-08-16T07:25:50.861ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
96922024-08-16T07:25:50.861ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 19 reason = Timeout
96932024-08-16T07:25:50.861ZWARNnexus (BackgroundTasks): region replacement task started background_task = region_replacement file = nexus/src/app/background/tasks/region_replacement.rs:64
96942024-08-16T07:25:50.861ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
96952024-08-16T07:25:50.861ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 19 reason = Timeout
96962024-08-16T07:25:50.861ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 19 reason = Timeout
96972024-08-16T07:25:50.861ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
96982024-08-16T07:25:50.861ZINFOnexus (BackgroundTasks): region snapshot replacement garbage collect task started background_task = region_snapshot_replacement_garbage_collection file = nexus/src/app/background/tasks/region_snapshot_replacement_garbage_collect.rs:133
96992024-08-16T07:25:50.861ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
97002024-08-16T07:25:50.861ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
97012024-08-16T07:25:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
97022024-08-16T07:25:50.862ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
97032024-08-16T07:25:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
97042024-08-16T07:25:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
97052024-08-16T07:25:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
97062024-08-16T07:25:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
97072024-08-16T07:25:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
97082024-08-16T07:25:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
97092024-08-16T07:25:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
97102024-08-16T07:25:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
97112024-08-16T07:25:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
97122024-08-16T07:25:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
97132024-08-16T07:25:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
97142024-08-16T07:25:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
97152024-08-16T07:25:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
97162024-08-16T07:25:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
97172024-08-16T07:25:50.862ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
97182024-08-16T07:25:50.862ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
97192024-08-16T07:25:50.862ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
97202024-08-16T07:25:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
97212024-08-16T07:25:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
97222024-08-16T07:25:50.862ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97232024-08-16T07:25:50.863ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97242024-08-16T07:25:50.863ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97252024-08-16T07:25:50.864ZINFOnexus (BackgroundTasks): lookup region port task done background_task = lookup_region_port file = nexus/src/app/background/tasks/lookup_region_port.rs:150
97262024-08-16T07:25:50.864ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 2.435386ms iteration = 10 status = {"errors":[],"found_port_ok":[]}
97272024-08-16T07:25:50.864ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97282024-08-16T07:25:50.864ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
97292024-08-16T07:25:50.865ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
97302024-08-16T07:25:50.865ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97312024-08-16T07:25:50.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97322024-08-16T07:25:50.865ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
97332024-08-16T07:25:50.865ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
97342024-08-16T07:25:50.865ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
97352024-08-16T07:25:50.865ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
97362024-08-16T07:25:50.865ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
97372024-08-16T07:25:50.865ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
97382024-08-16T07:25:50.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
97392024-08-16T07:25:50.865ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
97402024-08-16T07:25:50.865ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
97412024-08-16T07:25:50.865ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
97422024-08-16T07:25:50.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
97432024-08-16T07:25:50.865ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
97442024-08-16T07:25:50.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
97452024-08-16T07:25:50.866ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
97462024-08-16T07:25:50.866ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
97472024-08-16T07:25:50.866ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 4.391561ms iteration = 10 status = {"error":null,"error_count":0,"found":0,"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0}
97482024-08-16T07:25:50.866ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97492024-08-16T07:25:50.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
97502024-08-16T07:25:50.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97512024-08-16T07:25:50.866ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
97522024-08-16T07:25:50.866ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
97532024-08-16T07:25:50.866ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
97542024-08-16T07:25:50.866ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
97552024-08-16T07:25:50.866ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
97562024-08-16T07:25:50.866ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97572024-08-16T07:25:50.866ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
97582024-08-16T07:25:50.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
97592024-08-16T07:25:50.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
97602024-08-16T07:25:50.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
97612024-08-16T07:25:50.867ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
97622024-08-16T07:25:50.867ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
97632024-08-16T07:25:50.867ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 6.173542ms iteration = 19 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
97642024-08-16T07:25:50.868ZWARNnexus (BackgroundTasks): physical disk adoption task started background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:100
97652024-08-16T07:25:50.868ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
97662024-08-16T07:25:50.868ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97672024-08-16T07:25:50.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
97682024-08-16T07:25:50.868ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97692024-08-16T07:25:50.868ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
97702024-08-16T07:25:50.868ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
97712024-08-16T07:25:50.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
97722024-08-16T07:25:50.868ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97732024-08-16T07:25:50.869ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97742024-08-16T07:25:50.869ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
97752024-08-16T07:25:50.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
97762024-08-16T07:25:50.870ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97772024-08-16T07:25:50.870ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
97782024-08-16T07:25:50.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
97792024-08-16T07:25:50.871ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1614, tv_nsec: 248430027 } })
97802024-08-16T07:25:50.871ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
97812024-08-16T07:25:50.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
97822024-08-16T07:25:50.872ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
97832024-08-16T07:25:50.872ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
97842024-08-16T07:25:50.872ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
97852024-08-16T07:25:50.872ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
97862024-08-16T07:25:50.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
97872024-08-16T07:25:50.872ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97882024-08-16T07:25:50.872ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
97892024-08-16T07:25:50.872ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
97902024-08-16T07:25:50.872ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
97912024-08-16T07:25:50.872ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
97922024-08-16T07:25:50.872ZINFOnexus (BackgroundTasks): region snapshot replacement start task done background_task = region_snapshot_replacement_start file = nexus/src/app/background/tasks/region_snapshot_replacement_start.rs:252
97932024-08-16T07:25:50.872ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 10.758529ms iteration = 19 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
97942024-08-16T07:25:50.872ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97952024-08-16T07:25:50.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
97962024-08-16T07:25:50.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
97972024-08-16T07:25:50.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
97982024-08-16T07:25:50.872ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
97992024-08-16T07:25:50.873ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
98002024-08-16T07:25:50.873ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 11.309521ms iteration = 19 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
98012024-08-16T07:25:50.873ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98022024-08-16T07:25:50.873ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
98032024-08-16T07:25:50.873ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 12.208211ms iteration = 55 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
98042024-08-16T07:25:50.873ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
98052024-08-16T07:25:50.873ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
98062024-08-16T07:25:50.873ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
98072024-08-16T07:25:50.874ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
98082024-08-16T07:25:50.874ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
98092024-08-16T07:25:50.874ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = ddebb22e-3faa-4936-9b3e-0f4d28827c0e dns_zone_name = oxide.test found_so_far = 0 version = 2
98102024-08-16T07:25:50.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
98112024-08-16T07:25:50.874ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
98122024-08-16T07:25:50.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
98132024-08-16T07:25:50.875ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98142024-08-16T07:25:50.875ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
98152024-08-16T07:25:50.875ZWARNnexus (BackgroundTasks): region replacement task done background_task = region_replacement file = nexus/src/app/background/tasks/region_replacement.rs:185
98162024-08-16T07:25:50.875ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
98172024-08-16T07:25:50.875ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 13.463371ms iteration = 19 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
98182024-08-16T07:25:50.875ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
98192024-08-16T07:25:50.875ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98202024-08-16T07:25:50.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
98212024-08-16T07:25:50.875ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
98222024-08-16T07:25:50.875ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
98232024-08-16T07:25:50.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98242024-08-16T07:25:50.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
98252024-08-16T07:25:50.875ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98262024-08-16T07:25:50.876ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98272024-08-16T07:25:50.877ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
98282024-08-16T07:25:50.877ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
98292024-08-16T07:25:50.877ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
98302024-08-16T07:25:50.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
98312024-08-16T07:25:50.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
98322024-08-16T07:25:50.878ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98332024-08-16T07:25:50.878ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
98342024-08-16T07:25:50.878ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
98352024-08-16T07:25:50.878ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98362024-08-16T07:25:50.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
98372024-08-16T07:25:50.878ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
98382024-08-16T07:25:50.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
98392024-08-16T07:25:50.879ZWARNnexus (BackgroundTasks): physical disk adoption task done background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:174
98402024-08-16T07:25:50.879ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 23.199196ms iteration = 21 status = {"physical_disks_added":0}
98412024-08-16T07:25:50.879ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
98422024-08-16T07:25:50.879ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
98432024-08-16T07:25:50.879ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
98442024-08-16T07:25:50.879ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
98452024-08-16T07:25:50.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
98462024-08-16T07:25:50.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
98472024-08-16T07:25:50.880ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98482024-08-16T07:25:50.880ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
98492024-08-16T07:25:50.880ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 2c55b660-f328-498e-b44c-73da75015ed4 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
98502024-08-16T07:25:50.880ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
98512024-08-16T07:25:50.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
98522024-08-16T07:25:50.881ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = ddebb22e-3faa-4936-9b3e-0f4d28827c0e dns_zone_name = oxide.test found_so_far = 1 version = 2
98532024-08-16T07:25:50.881ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
98542024-08-16T07:25:50.881ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-08-16 07:16:55.724690 UTC dns_group = external generation = 2
98552024-08-16T07:25:50.881ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 25.168131ms iteration = 10 status = {"generation":2}
98562024-08-16T07:25:50.881ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 24.591188ms iteration = 5 status = {"nsuccess":5}
98572024-08-16T07:25:50.881ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
98582024-08-16T07:25:50.881ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
98592024-08-16T07:25:50.881ZINFOnexus (BackgroundTasks): region snapshot replacement garbage collect task done background_task = region_snapshot_replacement_garbage_collection file = nexus/src/app/background/tasks/region_snapshot_replacement_garbage_collect.rs:147
98602024-08-16T07:25:50.881ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 19.5137ms iteration = 19 status = {"errors":[],"garbage_collect_requested":[]}
98612024-08-16T07:25:50.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
98622024-08-16T07:25:50.881ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98632024-08-16T07:25:50.881ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
98642024-08-16T07:25:50.881ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
98652024-08-16T07:25:50.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
98662024-08-16T07:25:50.882ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
98672024-08-16T07:25:50.882ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
98682024-08-16T07:25:50.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
98692024-08-16T07:25:50.882ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
98702024-08-16T07:25:50.882ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 27.107936ms iteration = 55 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
98712024-08-16T07:25:50.883ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98722024-08-16T07:25:50.883ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
98732024-08-16T07:25:50.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
98742024-08-16T07:25:50.884ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
98752024-08-16T07:25:50.884ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
98762024-08-16T07:25:50.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
98772024-08-16T07:25:50.884ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
98782024-08-16T07:25:50.884ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
98792024-08-16T07:25:50.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
98802024-08-16T07:25:50.885ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 2c55b660-f328-498e-b44c-73da75015ed4 dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
98812024-08-16T07:25:50.886ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
98822024-08-16T07:25:50.886ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-08-16 07:16:55.302318 UTC dns_group = internal generation = 1
98832024-08-16T07:25:50.886ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 30.362382ms iteration = 10 status = {"generation":1}
98842024-08-16T07:25:50.893ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
98852024-08-16T07:25:50.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
98862024-08-16T07:25:50.894ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
98872024-08-16T07:25:50.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
98882024-08-16T07:25:50.895ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98892024-08-16T07:25:50.897ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
98902024-08-16T07:25:50.897ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
98912024-08-16T07:25:50.897ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 40.71241ms iteration = 10 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
98922024-08-16T07:25:50.897ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae, lookup_type: ById(03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae) } result = Ok(())
98932024-08-16T07:25:50.897ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
98942024-08-16T07:25:50.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
98952024-08-16T07:25:50.898ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 37.173149ms iteration = 19 status = 0
98962024-08-16T07:25:50.913ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-08-16T07:16:49.943339Z, time_modified: 2024-08-16T07:16:49.943339Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, db_silo: Silo { identity: SiloIdentity { id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-16T07:16:55.682566Z, time_modified: 2024-08-16T07:16:55.682566Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "c9e400628d2b58a74b998fbfa44a053952e83a6e8d3c49e6518981bf7d4a006f" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, db_silo: Silo { identity: SiloIdentity { id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-16T07:16:55.682566Z, time_modified: 2024-08-16T07:16:55.682566Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "c9e400628d2b58a74b998fbfa44a053952e83a6e8d3c49e6518981bf7d4a006f" }] }) }
98972024-08-16T07:25:50.913ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 57.59695ms iteration = 10 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071","tls_certs":["c9e400628d2b58a74b998fbfa44a053952e83a6e8d3c49e6518981bf7d4a006f"]}},"default_endpoint":{"silo_id":"439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071","tls_certs":["c9e400628d2b58a74b998fbfa44a053952e83a6e8d3c49e6518981bf7d4a006f"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
98982024-08-16T07:25:50.989ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
98992024-08-16T07:25:51.001ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
99002024-08-16T07:25:51.001ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
99012024-08-16T07:25:51.001ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "2ff98c2c-2388-46e9-93df-40eabff7b680", "content-length": "26", "date": "Fri, 16 Aug 2024 07:25:51 GMT"} })
99022024-08-16T07:25:51.001ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
99032024-08-16T07:25:51.003ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
99042024-08-16T07:25:51.013ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
99052024-08-16T07:25:51.072ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
99062024-08-16T07:25:51.072ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
99072024-08-16T07:25:51.072ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "1d486217-dfb8-46f3-8660-2ae171f77535", "content-length": "26", "date": "Fri, 16 Aug 2024 07:25:51 GMT"} })
99082024-08-16T07:25:51.072ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
99092024-08-16T07:25:51.073ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
99102024-08-16T07:25:51.103ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
99112024-08-16T07:25:51.104ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "8611f3a3-efc2-4f47-a47c-4a6e8655cbcc", "content-length": "372", "date": "Fri, 16 Aug 2024 07:25:51 GMT"} })
99122024-08-16T07:25:51.104ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99132024-08-16T07:25:51.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99142024-08-16T07:25:51.105ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99152024-08-16T07:25:51.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99162024-08-16T07:25:51.108ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99172024-08-16T07:25:51.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99182024-08-16T07:25:51.110ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
99192024-08-16T07:25:51.110ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "9fcadfea-36db-4847-bb87-5e10836d1f9b", "date": "Fri, 16 Aug 2024 07:25:51 GMT"} })
99202024-08-16T07:25:51.111ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 250.230259ms iteration = 20 status = {}
99212024-08-16T07:25:51.115ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
99222024-08-16T07:25:51.116ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d4310c9a-e745-44f6-bb09-036fe380c1ec", "content-length": "691", "date": "Fri, 16 Aug 2024 07:25:51 GMT"} })
99232024-08-16T07:25:51.116ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
99242024-08-16T07:25:51.116ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
99252024-08-16T07:25:51.116ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
99262024-08-16T07:25:51.118ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 256.735729ms iteration = 20 status = {}
99272024-08-16T07:25:51.147ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a zone_address = fd00:1122:3344:101::2
99282024-08-16T07:25:51.147ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
99292024-08-16T07:25:51.147ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "76455d08-0bec-4c34-9725-800695442909", "content-length": "26", "date": "Fri, 16 Aug 2024 07:25:51 GMT"} })
99302024-08-16T07:25:51.147ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
99312024-08-16T07:25:51.149ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
99322024-08-16T07:25:51.166ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
99332024-08-16T07:25:51.180ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
99342024-08-16T07:25:51.180ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "bd1262f6-606e-4496-94d0-036d5c0f407b", "date": "Fri, 16 Aug 2024 07:25:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
99352024-08-16T07:25:51.180ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
99362024-08-16T07:25:51.182ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "b2fe1f6c-3ec4-4140-ae95-604242da4b19", "date": "Fri, 16 Aug 2024 07:25:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
99372024-08-16T07:25:51.182ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
99382024-08-16T07:25:51.183ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
99392024-08-16T07:25:51.183ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 321.783872ms iteration = 12 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
99402024-08-16T07:25:51.193ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 2cda630a-4493-4613-a9cd-91342366958e roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
99412024-08-16T07:25:51.194ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 2cda630a-4493-4613-a9cd-91342366958e resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
99422024-08-16T07:25:51.195ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2124 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 2cda630a-4493-4613-a9cd-91342366958e response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
99432024-08-16T07:25:51.207ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
99442024-08-16T07:25:51.207ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "4cd9e806-2b44-4600-a1ff-8aa7de0e7c2c", "content-length": "2", "date": "Fri, 16 Aug 2024 07:25:50 GMT"} })
99452024-08-16T07:25:51.209ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
99462024-08-16T07:25:51.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
99472024-08-16T07:25:51.211ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 355.463799ms iteration = 19 status = null
99482024-08-16T07:25:51.218ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 363.177288ms iteration = 19 status = {}
99492024-08-16T07:25:51.313ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
99502024-08-16T07:25:51.313ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "f708e8d1-a096-47d8-8c9d-bad964e9cb7e", "date": "Fri, 16 Aug 2024 07:25:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
99512024-08-16T07:25:51.313ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
99522024-08-16T07:25:51.315ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "785449e0-fda5-419c-9d5f-051cf8a82955", "date": "Fri, 16 Aug 2024 07:25:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
99532024-08-16T07:25:51.315ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
99542024-08-16T07:25:51.317ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "c3d54cb5-4bb9-49d3-9a2c-2881f7e9cb8e", "date": "Fri, 16 Aug 2024 07:25:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
99552024-08-16T07:25:51.318ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
99562024-08-16T07:25:51.319ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
99572024-08-16T07:25:51.319ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 464.022706ms iteration = 12 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
99582024-08-16T07:25:51.380ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99592024-08-16T07:25:51.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99602024-08-16T07:25:51.381ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:146 port = SwitchPort { id: f13c0939-2c9d-4a0d-b006-5f3de89cc4fc, rack_id: e1b0d583-7b20-4a4b-97f9-9f83300aeb7a, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(4de7fcf8-2b1f-4b0e-ba6f-584e8a34addb) } rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0
99612024-08-16T07:25:51.381ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99622024-08-16T07:25:51.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99632024-08-16T07:25:51.399ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
99642024-08-16T07:25:51.399ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "92b6873a-b7b9-4087-8c14-56e5c2f9476c", "content-length": "121", "date": "Fri, 16 Aug 2024 07:25:50 GMT"} })
99652024-08-16T07:25:51.399ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1663 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
99662024-08-16T07:25:51.399ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1690 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 4de7fcf8-2b1f-4b0e-ba6f-584e8a34addb
99672024-08-16T07:25:51.400ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None)}}
99682024-08-16T07:25:51.400ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None)}}
99692024-08-16T07:25:51.400ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {}
99702024-08-16T07:25:51.400ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {}
99712024-08-16T07:25:51.400ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
99722024-08-16T07:25:51.400ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99732024-08-16T07:25:51.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99742024-08-16T07:25:51.401ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
99752024-08-16T07:25:51.402ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "90cacd03-da06-40e0-b4b0-4ab64399c851", "content-length": "2", "date": "Fri, 16 Aug 2024 07:25:50 GMT"} })
99762024-08-16T07:25:51.402ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
99772024-08-16T07:25:51.403ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "480337f6-96df-4ce2-a719-f9cfe16731fc", "content-length": "52", "date": "Fri, 16 Aug 2024 07:25:50 GMT"} })
99782024-08-16T07:25:51.403ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0
99792024-08-16T07:25:51.403ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
99802024-08-16T07:25:51.459ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "a43c3bc8-895f-4b5c-949a-cd56cca5063c", "date": "Fri, 16 Aug 2024 07:25:51 GMT"} })
99812024-08-16T07:25:51.459ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch = Switch0
99822024-08-16T07:25:51.459ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
99832024-08-16T07:25:51.459ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f52b4d82-fd12-4e2f-84c4-8c416823d536", "content-length": "494", "date": "Fri, 16 Aug 2024 07:25:51 GMT"} })
99842024-08-16T07:25:51.459ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99852024-08-16T07:25:51.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99862024-08-16T07:25:51.462ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99872024-08-16T07:25:51.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99882024-08-16T07:25:51.465ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99892024-08-16T07:25:51.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99902024-08-16T07:25:51.467ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99912024-08-16T07:25:51.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99922024-08-16T07:25:51.474ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 612.700871ms iteration = 19 status = {}
99932024-08-16T07:25:51.778ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 819 local_addr = [fd00:1122:3344:101::c]:53719 method = GET remote_addr = [fd00:1122:3344:101::d]:60737 req_id = d0bfb5d7-2f36-4c05-9ed6-a8d80c0c4e3a response_code = 200 uri = /0d900881-9285-4dbf-910f-5e4676c8f133
99942024-08-16T07:25:52.216ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 84d35176-b5ff-4e10-800a-502fb443ebb9 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
99952024-08-16T07:25:52.216ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 84d35176-b5ff-4e10-800a-502fb443ebb9 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
99962024-08-16T07:25:52.218ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2228 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 84d35176-b5ff-4e10-800a-502fb443ebb9 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
99972024-08-16T07:25:53.237ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 1a4246b0-7022-4bef-9d66-893f0c7c1e30 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
99982024-08-16T07:25:53.238ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 1a4246b0-7022-4bef-9d66-893f0c7c1e30 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
99992024-08-16T07:25:53.240ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2508 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 1a4246b0-7022-4bef-9d66-893f0c7c1e30 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
100002024-08-16T07:25:54.260ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 969915a6-5096-4a45-8892-695c7c6c0c89 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
100012024-08-16T07:25:54.260ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 969915a6-5096-4a45-8892-695c7c6c0c89 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
100022024-08-16T07:25:54.262ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2650 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 969915a6-5096-4a45-8892-695c7c6c0c89 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
100032024-08-16T07:25:55.281ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 5621f6bf-9c98-4419-9ae8-e2db5411ab86 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
100042024-08-16T07:25:55.281ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 5621f6bf-9c98-4419-9ae8-e2db5411ab86 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
100052024-08-16T07:25:55.283ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2385 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 5621f6bf-9c98-4419-9ae8-e2db5411ab86 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
100062024-08-16T07:25:56.303ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 9a97997f-ebc1-4cea-9bca-f8ffad86828e roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
100072024-08-16T07:25:56.303ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 9a97997f-ebc1-4cea-9bca-f8ffad86828e resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
100082024-08-16T07:25:56.305ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2258 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 9a97997f-ebc1-4cea-9bca-f8ffad86828e response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
100092024-08-16T07:25:57.325ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = eec7855d-51de-4a8a-b12a-b14c5b943f81 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
100102024-08-16T07:25:57.325ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = eec7855d-51de-4a8a-b12a-b14c5b943f81 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
100112024-08-16T07:25:57.327ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2509 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = eec7855d-51de-4a8a-b12a-b14c5b943f81 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
100122024-08-16T07:25:58.346ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = abcfa976-f33c-4205-aef4-2d55008b7160 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
100132024-08-16T07:25:58.346ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = abcfa976-f33c-4205-aef4-2d55008b7160 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
100142024-08-16T07:25:58.348ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2675 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = abcfa976-f33c-4205-aef4-2d55008b7160 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
100152024-08-16T07:25:59.369ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 49bd4d3b-678e-4623-bbfb-a125fbad5ac1 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
100162024-08-16T07:25:59.369ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 49bd4d3b-678e-4623-bbfb-a125fbad5ac1 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
100172024-08-16T07:25:59.371ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2488 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 49bd4d3b-678e-4623-bbfb-a125fbad5ac1 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
100182024-08-16T07:26:00.389ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = ee4d2480-4a7d-49a4-b092-cdae2767d63c roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
100192024-08-16T07:26:00.390ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = ee4d2480-4a7d-49a4-b092-cdae2767d63c resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
100202024-08-16T07:26:00.391ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1952 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = ee4d2480-4a7d-49a4-b092-cdae2767d63c response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
100212024-08-16T07:26:00.855ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 56 reason = Timeout
100222024-08-16T07:26:00.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100232024-08-16T07:26:00.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100242024-08-16T07:26:00.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100252024-08-16T07:26:00.859ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
100262024-08-16T07:26:00.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100272024-08-16T07:26:00.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100282024-08-16T07:26:00.860ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100292024-08-16T07:26:00.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100302024-08-16T07:26:00.861ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 56 reason = Timeout
100312024-08-16T07:26:00.861ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
100322024-08-16T07:26:00.861ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
100332024-08-16T07:26:00.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
100342024-08-16T07:26:00.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100352024-08-16T07:26:00.862ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
100362024-08-16T07:26:00.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
100372024-08-16T07:26:00.863ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
100382024-08-16T07:26:00.863ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100392024-08-16T07:26:00.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100402024-08-16T07:26:00.864ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
100412024-08-16T07:26:00.864ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.287456ms iteration = 56 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
100422024-08-16T07:26:00.870ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
100432024-08-16T07:26:00.870ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 14.267129ms iteration = 56 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
100442024-08-16T07:26:01.261ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64556 req_id = 2793e35b-b05e-4f13-aa12-f9cb09497e0b roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
100452024-08-16T07:26:01.262ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64556 req_id = 2793e35b-b05e-4f13-aa12-f9cb09497e0b resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
100462024-08-16T07:26:01.264ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2438 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64556 req_id = 2793e35b-b05e-4f13-aa12-f9cb09497e0b response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
100472024-08-16T07:26:01.411ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 6109da00-3a4b-4fc4-9dca-4ab5eacf44a8 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
100482024-08-16T07:26:01.412ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 6109da00-3a4b-4fc4-9dca-4ab5eacf44a8 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
100492024-08-16T07:26:01.413ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2150 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 6109da00-3a4b-4fc4-9dca-4ab5eacf44a8 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
100502024-08-16T07:26:01.777ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 692 local_addr = [fd00:1122:3344:101::c]:53719 method = GET remote_addr = [fd00:1122:3344:101::d]:60737 req_id = ba8a8e87-54b2-43e6-a7f3-321f5cfef569 response_code = 200 uri = /0d900881-9285-4dbf-910f-5e4676c8f133
100512024-08-16T07:26:02.433ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = dfb20bdb-3eb0-4f2f-8a4a-a70428eff182 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
100522024-08-16T07:26:02.433ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = dfb20bdb-3eb0-4f2f-8a4a-a70428eff182 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
100532024-08-16T07:26:02.435ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2107 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = dfb20bdb-3eb0-4f2f-8a4a-a70428eff182 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
100542024-08-16T07:26:03.455ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = ba32eb81-208d-46f2-8333-c8dacde3b919 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
100552024-08-16T07:26:03.455ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = ba32eb81-208d-46f2-8333-c8dacde3b919 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
100562024-08-16T07:26:03.457ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1871 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = ba32eb81-208d-46f2-8333-c8dacde3b919 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
100572024-08-16T07:26:04.476ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 70b6a757-acaf-454f-bf43-23c18d1c268b roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
100582024-08-16T07:26:04.476ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 70b6a757-acaf-454f-bf43-23c18d1c268b resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
100592024-08-16T07:26:04.478ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1907 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 70b6a757-acaf-454f-bf43-23c18d1c268b response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
100602024-08-16T07:26:05.498ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 019693c3-9819-4ee6-b4ae-390915c33a46 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
100612024-08-16T07:26:05.498ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 019693c3-9819-4ee6-b4ae-390915c33a46 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
100622024-08-16T07:26:05.499ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1948 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 019693c3-9819-4ee6-b4ae-390915c33a46 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
100632024-08-16T07:26:06.519ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 7e5a196f-cca8-4b30-acc0-faf698b50728 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
100642024-08-16T07:26:06.519ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 7e5a196f-cca8-4b30-acc0-faf698b50728 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
100652024-08-16T07:26:06.521ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1996 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 7e5a196f-cca8-4b30-acc0-faf698b50728 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
100662024-08-16T07:26:07.541ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = e95f706d-ca78-41ef-bdea-a19eb22421b0 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
100672024-08-16T07:26:07.541ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = e95f706d-ca78-41ef-bdea-a19eb22421b0 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
100682024-08-16T07:26:07.543ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1902 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = e95f706d-ca78-41ef-bdea-a19eb22421b0 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
100692024-08-16T07:26:08.562ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = ece8f331-4a35-4455-89a2-733544171f65 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
100702024-08-16T07:26:08.562ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = ece8f331-4a35-4455-89a2-733544171f65 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
100712024-08-16T07:26:08.564ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1917 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = ece8f331-4a35-4455-89a2-733544171f65 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
100722024-08-16T07:26:09.584ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = de017eb0-91fa-47b8-97e1-6c25f9feb201 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
100732024-08-16T07:26:09.584ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = de017eb0-91fa-47b8-97e1-6c25f9feb201 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
100742024-08-16T07:26:09.586ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1942 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = de017eb0-91fa-47b8-97e1-6c25f9feb201 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
100752024-08-16T07:26:10.607ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = e4e620a8-14aa-43d9-ba09-3e2136767cab roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
100762024-08-16T07:26:10.607ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = e4e620a8-14aa-43d9-ba09-3e2136767cab resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
100772024-08-16T07:26:10.609ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1941 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = e4e620a8-14aa-43d9-ba09-3e2136767cab response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
100782024-08-16T07:26:10.856ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 57 reason = Timeout
100792024-08-16T07:26:10.856ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100802024-08-16T07:26:10.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100812024-08-16T07:26:10.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100822024-08-16T07:26:10.860ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
100832024-08-16T07:26:10.860ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100842024-08-16T07:26:10.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100852024-08-16T07:26:10.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100862024-08-16T07:26:10.861ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 57 reason = Timeout
100872024-08-16T07:26:10.861ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
100882024-08-16T07:26:10.861ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
100892024-08-16T07:26:10.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100902024-08-16T07:26:10.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
100912024-08-16T07:26:10.862ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100922024-08-16T07:26:10.862ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
100932024-08-16T07:26:10.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
100942024-08-16T07:26:10.864ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
100952024-08-16T07:26:10.864ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 2.912837ms iteration = 57 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
100962024-08-16T07:26:10.864ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
100972024-08-16T07:26:10.864ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100982024-08-16T07:26:10.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100992024-08-16T07:26:10.870ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
101002024-08-16T07:26:10.870ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 14.878183ms iteration = 57 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
101012024-08-16T07:26:11.628ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = db33becd-447b-48cb-9a7f-32ea0f72d9ea roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
101022024-08-16T07:26:11.628ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = db33becd-447b-48cb-9a7f-32ea0f72d9ea resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
101032024-08-16T07:26:11.630ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2067 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = db33becd-447b-48cb-9a7f-32ea0f72d9ea response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
101042024-08-16T07:26:11.778ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1251 local_addr = [fd00:1122:3344:101::c]:53719 method = GET remote_addr = [fd00:1122:3344:101::d]:60737 req_id = 2b30a276-09db-474a-b913-bfe1649a55a8 response_code = 200 uri = /0d900881-9285-4dbf-910f-5e4676c8f133
101052024-08-16T07:26:12.649ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 3bc1e787-4502-4baa-9ca2-3e57c693b7fa roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
101062024-08-16T07:26:12.649ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 3bc1e787-4502-4baa-9ca2-3e57c693b7fa resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
101072024-08-16T07:26:12.651ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2579 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 3bc1e787-4502-4baa-9ca2-3e57c693b7fa response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
101082024-08-16T07:26:13.672ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 979711b8-4c04-46aa-9780-c8cb44d49ec5 roles = RoleSet { roles: {} } uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
101092024-08-16T07:26:13.672ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 979711b8-4c04-46aa-9780-c8cb44d49ec5 resource = Database result = Ok(()) uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
101102024-08-16T07:26:13.674ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 3012 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48494 req_id = 979711b8-4c04-46aa-9780-c8cb44d49ec5 response_code = 200 uri = /probes/03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae